Pop over to Sir Sam's NOOB guide (
viewtopic.php?f=5&t=54207) and follow the link to download a copy of the 02 Factory Service Manual which should help.
I don't know the 02 has an "on/off" valve in the heater core line - 05/06 models don't
1. if both heater core lines are hot then coolant is flowing and you have a heater air circulation problem. Could be blend door or mode control or could be "stuff" in the heater box. I mention the latter because I had a 1993 Dodge D-250 Cummins whose heater box was so stuffed with leaves (cowl drain design problem) that little AC or heat air would flow until I cleaned the beast out; fortunately access was not hard (heat/AC box was right there so I could cut in and fit cleanout port and some window screen glued to the bottom of the cowl grill took care of future leaves. FSM should tell you what type of controls you have (vacuum or electric) and where they are. On the 05/06 the blend door is an electric motor and the actuator/mode switch is vacuum operated.
2. if one line is hot and the other much cooler you probably have a clogged heater core (unless of course the 02 has an "on/off" valve in the heater core line in which case the valve may be bad and need to be replaced). If the heater core is clogged it's likely possible to "reverse" flush it by disconnecting both heater core lines up near the thermostat; inducing water under light>moderate pressure into the heater core outflow line to flush any crud back out the inflow line. Best catch the outflow in a bucket or some such; keeps the mess down and lets you see what comes out. Under no circumstances use much pressure; you don't want to blow a hole in the heater core. Clogged coolant systems are not uncommon if you mix differents types, not brands, of coolant.
If you have to pull the dash to get to things then doing so does not appear to be very hard just tedious per the FSM