Define the task, success criteria, site conditions, operator group, maintenance review, documentation requirements, and reporting cadence before the pilot starts. The pilot should test representative work, not ideal conditions only. Capture productivity observations, safety feedback, service access issues, downtime events, parts needs, and operator comments. A pilot without predefined measures often becomes anecdotal.