Is it possible to run fiber on OpenPai ?

[tomjamescn]

We have an AI cluster built on top of OpenPai from Microsoft, Is there an avaiable backend for OpenPai? Thanks.

We use OpenPai 0.14.0 which based on kubernetes v1.9.9, v1.9.9 have no device plugin support.

[calio]

Hi @tomjamescn, that's an interesting platform from Microsoft. Personally I haven't used it before but seems that it won't be too hard to create a backend to it. I check the document, it has APIs to submit a job, get job status, and start /stop job, which is exactly what's needed by fiber. Would you be interested to contribute a new OpenPai backend? You can follow this example https://github.com/uber/fiber/blob/master/fiber/kubernetes_backend.py . I can provide help along the way.

[tomjamescn]

@calio thanks for your response, I have much interesting to contribute a openpai-backend, I would try.

I have a problem that how fiber deal with communication between master and worker process, I found no config about port for communication. As I know, I could give head and node the port config in Ray.

[calio]

By default, Fiber master will pick a random port to listen and workers will connect to that port. See ipc_admin_master_port in https://uber.github.io/fiber/config/. If there is a specific port you want to use, you can set ipc_admin_master_port.