How can do upgrade if the package loaded on evaluation branch on ePO?

ePo update from deployment task of selected branch evaluation

Yes, Above one is absolutely right, Adding more to this if this is just an update you need to modify respective agent policy to take update from respective branch.

We can configure in the deployment task with selecting the point product option in the branch(Current , evaluation and previous).