There is one more parameter that should be used during configure step of building PHP to make phpMyAdmin happy --enable-mbstring so the final configuration string looks like this
./configure --with-apxs2=/usr/sbin/apxs --with-mysql=/usr --with-gd=/usr --with-zlib=/usr --enable-mbstring