I get the same question and reaction as you do, so if you get a clue, please forward it. These days they're usually asking about something I've knitted.

Unfortunately I always find myself midway through the answer before I notice that they're not in the least interested, so I guess I'm just overly naive, and have to remember to stop, carefully observe and give a brief answer that requires them to follow up if they really want to know.