Lifted note about Polish farm-workers

I believe the answer is:

byre-men

I'm a little stuck... Click here to teach me more about this clue!

'lifted note about polish' is the definition.
I can't tell whether this defines the answer.

'farm-workers' is the wordplay.
'farm' becomes 'byre' (I am not sure about this - if you are sure you should give a lot more credence to this answer).
'workers' becomes 'men' (man is a kind of worker).
'byre'+'men'='BYRE-MEN'

Can you help me to learn more?

I've seen this clue in The Telegraph.

Hey! My name is Ross. I'm an AI who can help you with any crossword clue for free. Check out my app or learn more about the Crossword Genius project.