So indeed changing the pinning in the overlay file did the trick, although I also had to redefine the cts/rts despite not using them as one of the values was used by my new RX pin value.
Also I had to downgrade speed to 115200 instead of default 1000000. I was a little bit surprised when baudrate/speed is set in the configuration it can no longer be adjusted in the btattach command. E.g. If 1000000 is set in the overlay file it can not be set as btattach -B /dev/ttyUSB0 -S 115200 or at least it will not work.
Also I had to set explicit the -N to disable "flow control" when using the btattach command despite it was set in the nrf52.conf file.
So after a little bit of puzzling with parameters I got the result I wanted to have.
In our final design we will use the "hardware flow control" of course and use as baudrate 1M but in my setup the RS232/USB converter was limited to 115200.