Vector B in Magnetic Potential Energy

U = -m x B

Is B the total magnetic field of the whole system?
If there is two objects X,Z and they all have a magnetic field. But different strengths,
I want to calculate the U for Z, B should be the total magnetic field of BOTH fields or only X's field strength?

Since X is the external magnetic field.