The fate of more than 600 refugees on Nauru is casting a shadow over a regional conference being held in the tiny Pacific nation.