These things are easy to diagnose. If the vehicle moves AT ALL under its own power, the engine doesn't need to be rebuilt. If it doesn't... You probably already know why (holes where they shouldn't be, etc)
Sluggish response is universally a problem with air, which is usually accompanied by problems with smoke, which indicate too much fuel for the available air. The computer is expecting more air (boost!) and it doesn't know why it doesn't have it.
Samco or Mishimoto boost hoses are the answer for your boost hoses. If they are original or OEM type, run your hand along them. If it comes off black and filthy, your hoses are porous and should be replaced.
Second is the MAP sensor. IDparts sells one for $25, so this is cheap enough now that it should just be replaced rather than screwing with trying to clean an old sensor. Clean the new one after you have everything else working.
Third is the intake elbow kit. This replaces the entire elbow area and seals off the EGR completely and permanently, such that you have zero misunderstandings about where your boost is going and where the exhaust is going. The EGR valve as stock is a piece of junk and I do not believe it ever maintains a positive seal.
Fourth is the turbo and actuator. There is a little "air filter" under the vacuum actuator on the passenger side of the motor. The box is a vacuum reservoir, and the other electrical thing there is a vacuum controller. The supply line can be removed from the controller and connected to the vacuum actuator IF there is a problem with that or the vacuum reservoir. You can test this by unplugging the vacuum hose that proceeds under the water bottle and over to the "flying saucer" on the turbo. There is a rod under this silver thing that should drop about an inch. Connect the vacuum line and disconnect it a few times with the engine running to see this motion. If it is not about an inch in travel, then the turbo vanes are sticking. This requires removing the turbo to clean and resolve. Considering that you say your CRD can actually move, but it is just sluggish off the line, I am inclined to believe your turbo is just fine. The solution is most likely in one of the above items and not the turbo area.
With regard to rockers, does your engine at idle sound like this?
https://dl.dropboxusercontent.com/u/5447172/CRD-Before.mp4Or this?
https://dl.dropboxusercontent.com/u/5447172/CRD-After.mp4The first video was a CRD with two broken rockers, and you can hear that the idle isn't smooth. After, is when the rockers were all fixed. The RPM flare at the beginning illustrates how the GDE tune sounds on an engine. That is how you know the engine has one of their tunes.