OK, problem resolved in A-Shell/AIX 5.0.999.9, which you can get from the Update Center, or from
http://www.microsabio.net/dist/50rel/bin-aix/ash-5.0.999.9-aix-upd.tar.Z The latest 5.0 notes are at
http://www.microsabio.net/dist/50rel/ashdevnotes50.txt As I suspected, the issue was a difference in the underlying system locking call fcntl() - under Linux it returns EAGAIN on a locking conflict, and under AIX it returns EACCES. I'm not sure when the problem was introduced, but it probably happened during the last general ISAM-A update several months ago.
I'll try to get the 5.1 version updated shortly. (There's a complication with 5.1 in that some other recent patches have not been finalized. If that's hanging you up, let me know and I'll make you a special interim version.)