What will you do if you found a customer that is previously caught and identified shoplifter inside your store?

addressing him to get out of the shop 

First, act normal because we cannot judge the person because of what they have done before. Second, inform your superior on the previous incident and leave them to decide and do the corrective action.

You don't have to anything that will make a scene or such, all you have to do is to be wary and inform all of the staff at the store that a potential shoplifter is in the store. I say potential because even if he/she was previously caught shoplifting this does not mean that he/she will do it again. But you should always be on guard in case it happens again.