Github_team_sync_group_mapping - Pulling all AzureAD Groups (60,000+)

Seems that the team sync feature pulls every AzureAD group while terraforming. When building pipelines/deploying repos this causes long delays. Is it possible to limit or filter the groups which get pulled in?