I have an AW9523 hooked up to one of the PoE ports and it seems to be working.
I was wondring which kernel module you are using? I was looking through your patch file and I can't seem to find a mention of and AW9523 specific module. Also, how are you setting up the leds intended to be used with the kernel.
Ultimaltely I am trying to see if I can hook some extra LEDs into the kernel LED subsystem to allow things like HDD activity to flash them.