Hi tanayyy welcome to the forum.
Windows even with all your user apps closed still uses memory for windows and it's services. Windows also dynamically allocates ram for various caches.
Your machine will release memory to be used by apps when needed. You have nothing to worry about.
NmsUK