Nonrigid image registration is a key tool in medical imaging. Because of high degrees of freedom in nonrigid transforms, there have been many efforts to regularize the deformation based on some reasonable assumptions. Especially, motion invertibility and local tissue rigidity have been investigated as reasonable priors in image registration. There have been several papers on exploiting each constraint separately. These constraints are reasonable in respiratory motion estimation because breathing motion is invertible and there are some rigid structures such as bones. Using both constraints seems very attractive in respiratory motion registration since using invertibility prior alone usually causes bone warping in ribs. Using rigidity prior seems natural and straightforward. However, the "sliding effect" near the interface between rib cage and diaphragm makes problem harder because it is not locally invertible. In this area, invertibility and rigidity priors have opposite forces. Recently, we proposed a simple piecewise quadratic penalty that encourages the local invertibility of motions. In this work we relax this penalty function by using a Geman-type function that allows the deformation to be piecewise smooth instead of globally smooth. This allows the deformation to be discontinuous in the area of the interface between rib cage and diaphragm. With some small sacrifice of regularity, we could achieve more realistic discontinuous motion near diaphragm, better data fitting error as well as less bone warping. We applied this Geman-type function penalty only to the x- and y-direction partial derivatives of the z-direction deformation to address the sliding effect. 192 × 128 × 128 3D CT inhale and exhale images of a real patient were used to show the benefits of this new penalty method.