AWS Launches Open-Source File Mover Express for S3 Transfers
A new open-source tool optimizes large-scale file transfers between local systems and Amazon S3.
1Open-Source S3 Transfer Utility
AWS has introduced File Mover Express, an open-source application licensed under Apache 2.0 designed for high-speed file transfers. It supports macOS, Windows, and Linux environments. The tool focuses on moving large media assets to Amazon S3 at wire speed, providing a robust alternative to existing commercial transfer clients that often involve proprietary protocols.
2Daemon-Based Transfer Engine
The core architecture utilizes a daemon-based engine that decouples file transfers from active desktop sessions. This allows processes to continue running even after a user logs off or a machine disconnects. The engine can be deployed on local workstations, data center servers, or Amazon EC2 instances for flexible infrastructure management.
3Performance and Throughput Optimization
File Mover Express employs automatic parallel transfers and multipart uploads to maximize network throughput. The autotuning mode dynamically adjusts stream counts and chunk sizes based on connection quality. Users can also enable S3 Transfer Acceleration for distant buckets and set bandwidth limits to manage network usage during critical production workflows.
4Interface and Integration Options
The application features a drag-and-drop graphical user interface alongside a scriptable command line interface. Built using Go for the transfer engine and TypeScript with Angular for the frontend, it supports integration with AI assistants via MCP. This dual-interface approach caters to both manual media workflows and automated, script-driven pipeline requirements.
5Security and Identity Management
Security is enforced through HTTPS for all transfers, with encryption provided both in flight and at rest. Access control is managed via AWS Identity and Access Management using minimum-permission policies. For enterprise environments, the tool supports single sign-on through OpenID Connect, allowing teams to centralize identity management across their infrastructure.
6Data Integrity and Verification
To ensure data accuracy, the tool performs background checksum calculations and caches them locally for unchanged files. It supports multiple hashing algorithms including MD5, XXHash, XXHash64, and XXH3, allowing users to balance compatibility with performance. This integrity verification is essential for media teams handling large deliverables, camera cards, and daily assets.
7Addressing Media Industry Challenges
Media teams frequently struggle with transferring terabytes of data under tight deadlines. Traditional clients often fail when sessions end, while commercial tools introduce unnecessary licensing costs. By providing a free, open-source solution, AWS aims to simplify the movement of large assets between on-premises storage and the cloud for professional media production.
8Availability and Project Scope
The project source code is currently available on GitHub, with pre-built packages ready for immediate deployment across major operating systems. Developed by a team of AWS architects and engineers, the tool represents a strategic effort to streamline cloud ingestion workflows. It remains a community-driven project under the permissive Apache 2.0 license.
Original article: InfoQ — AWS Launches Open-Source File Mover Express for S3 Transfers