Yes there is.
When the man lifted the box from the ground he applied force to do so. The displacement is how high he lifted the box.
If there is no work done, the box would remain on the ground.
But take note gravity also plays a role. It also applies work on the box. If there is no gravity involved when the man lift the box and removed his hands from the box, the box would levitate!
Take note the man used a positive work while gravity has negative work.