According to the info your server has enough capacity to run the PBX faster.
I think it could be something related to the writing velocity of the hard drive.
Just to discard any issue, you should try to install the PBX on a vps for comparing the speed of GUI