actually, I missed that when run ldconfig, it actually complains libASICamera2.so is not an ELF file.
it is because after copying libASICamera2.so from ZWO SDK to my Pi4, somehow it is corrupted. after re-copy the libASICamera2.so and use command
file libASICamera2.so
to confirm it is an ELF file, ldconfig can run without a problem.
then everything works on the ASI678MC