If you are using IMAP, you do not need to migrate emails as these are stored on server but if you have downloaded these emails onto drive and they have been removed from server, in this case, it might get difficult to get these mails migrated.
One method is to configure a IMAP account with ample of storage space and then copy the email folders into IMAP account so thatb they are uploaded into email account first. Once the uploading process completes, you may configure same account in outlook windows and it will download emails onto windows pc in outlook. However, this process might be quite difficult and time taking and also might result into errors if there are a lot of emails.
If you have lot of emails for migration, you may use a third party application for migrating emails from one format to another as other method might not yield good results. In this case, you may first export emails from outlook mac in olm format and then convert them into pst format compatible with outlook windows using OLM to PST Converter Pro and then import in outlook windows using pst import feature.