Object tracking methods

How would I go about tracking an object in a video? I have tried using color filters, however I am running into problems because of lighting changing the desired objects color due to reflections. What other methods of tracking are possible, and how would I go about using them?