Yes, this is unusual, but possible.
Hayfever is basically an allergic reaction where pollen triggers activity in the immune system leading to inflammation. For some people, this can also lead to swollen glands around the inflamed tissue in a similar way to what you might get with the common cold or flu. Symptoms of hayfever and colds can overlap and it will be worth considering the possibility of a viral infection as an alternative explanation. In any case, if your swollen glands persist, seek medical advice.