By "Azure SSO" do you mean "Azure AD SSO"?
Via AAD Connect, you can hook up on-premises AD to Azure AD but they will have "Same Sign On" i.e. they will have to login twice with the same credentials.
Adding ADFS gives you "Single Sign On" i.e. if you have a valid cookie, you will not be prompted for a login.