In the Extensions tab, under the Mobile App (Ring Mode) settings, click the "Caller ID" dropdown to select which number to use.