Trust Scot. He knows what it feels like to have a car that ticks.
Anyway, how noticeable is the sound? You may also be hearing the sound of the fuel injectors because they will tick slightly. If its the lifter, you are just hearing the slack between parts until the oil is able to pump up the lifter, removing the slack.
Now I want to go see if my car ticks.