tf_test

find_free_port()

Function that gets a free port for the current process

get_local_rank(rank_info, rank_info_list)

Function that figures out the local rank based on a list of rank, hostname, and port gathered from each of the workers

get_rank_info(comm=MPI.COMM_WORLD)

Create a dict for this worker containing rank, hostname and port to be used by this worker

print0(msg, comm=MPI.COMM_WORLD)

Prints string "msg" from rank 0

set_tf_config(rank_info, rank_info_list)

Sets the TF_CONFIG environment variable for the current worker, based on the rank_info_list