Have you tried using ImageMagick after building it with "without X11" option? If so, what problems do you get? I think person(s) maintaining the port would be more of help if ImageMagick misbehaves after building it without X11 support (assuming you provide them more details than presented above).