Did you check the USB devices on your system with "lsusb"? You should get something like "Bus 001 Device 008: ID 03c3:4001 ZWO Systems ZWO Device" for the AM5.
On the Indi Control Panel for the ZWO AM5, you should see, among others, the AM5 port "ZWO_Systems_ZWO_Device_..." in the System Ports list and the Port being selected should be ZWO_Systems_ZWO_Device... one. Baud rate on mine is 9600, I have the automatic search enabled also.