Tensorflow Estimator - Periodic Evaluation on Eval Dataset

Question

The tensorflow documentation does not provide any example of how to perform a periodic evaluation of the model on an evaluation set.

Some people suggested the use o

Answer 1

Only a few parameters/options of Experiment are deprecated (what specific errors are you seeing?). If you create an Estimator that will do periodic checkpoints (using options in RunConfig) and an Experiment using it, you will get evaluation for each checkpoint by default when using train_and_evaluate method.

EDIT: As Maxime pointed out in the comments. He needed to add the following lines to get rid of his error:

os.environ['TF_CONFIG'] = json.dumps({'environment': 'local'})
config = tf.contrib.learn.RunConfig()