Reaching the full potential of X-ray nanotomography, in particular for biological samples, is limited by many factors, of which one of the most serious is radiation damage. Although sample deformation caused by radiation damage can be partly mitigated by cryogenic protection, it is still present in these conditions and, as we exemplify here using a specimen extracted from scales of the Cyphochilus beetle, it will pose a limit to the achievable imaging resolution. We demonstrate a generalized tomographic model, which optimally follows the sample morphological changes and attempts to recover the original sample structure close to the ideal, damage-free reconstruction. Whereas our demonstration was performed using ptychographic X-ray tomography, the method can be adopted for any tomographic imaging modality. Our application demonstrates improved reconstruction quality of radiation-sensitive samples, which will be of increasing relevance with the higher brightness of 4th generation synchrotron sources.