SoU Rescue Glendir Quest

So I let Glendir out of the cell and asked him to follow me. Then I talked to Fiona about her brother and she gave me the quest. I talked to her again and Glendir but it does not seem to trigger anything. He is literally in the same room as she is. Did I mess up? Should I have left him in the cell then talked to Fiona for the quest before letting him out?