A seat cushion with a slot in the back for your tailbone is what you need. Some of them on amazon have little straps and you can just put them over your bag handle between flights.

Often lower back pain is caused from too much direct pressure on your tailbone, rather than lack of lumbar support.

https://a.co/d/3BbZc4V