We're all taught to be polite, and it seems rude to not answer a direct question that is asked of you, but you should know that "anything you say can and will be used against you." The officer himself will tell you this when he's placing you under arrest, but it's true from the very first moment you are pulled over.
You have the right to remain silent. Exercise that right by refusing to answer any questions that may be incriminating.