Naw, keep it in a small, reasonable caliber.
If you start getting big calibers, before you know it you have some big, distorted, ugly, oversized Frankengun thing like the ones they're making now.
The original Remington was almost tiny, and certainly elegant. Find a small centerfire .41 or go with .38 S&W or .380.