Hi ,
Welcome to the Support Portal. How can we help?

How can I limit the Workspace 365 Azure AD application so only specific people can use it?

This is not needed, because Workspace 365 handles this with its own user management, so the user has to be added to the Workspace 365 environment before it can sign in.