Work done on an object depends on:

(i) Strength of the force applied: Consider a lighter and a heavier bag, it is harder to lift the heavier bag. Hence, work done depends on the strength of the force.

(ii) Net Distance: Consider a bag, in first case you lifted it to a larger height. It requires more effort to lift the bag to larger distance. Hence, work done also depends on the net distance.