Yeah...easy to explain...a pain in the ass to execute.
Dupe your video layer first...then basically, you are going to mask the car colour by building the mask around it point to point--(hopefully the car is in the same spot, otherwise you have to track it which can be another hassle altogether) Top layer excludes everything but the car colour and bottom is unaffected-- Then just colorize the car as you see fit. Adjust the feather percentage to account for any miscalculations in your mask, and viola! Depending on your mask default settings, you may have to invert in order to get the proper masking effect.
If you have to mask amny small areas, I might suggest you render high res and detail on top of a series of prebuilds. We used to do that on Star Trek a lot, and it saved time dealing with AE crashes mid mask.
good luck