Jenxi you can delete the vendor folder (or just the extension folder inside vendor apparently, I just tested) and run composer install, it will reinstall the vendor folder based on its composer.lock state (should be exactly what you had before those files were deleted)
But if you're just trying to delete the extension, composer remove with the extension name should still work even if some files are missing in vendor.
