A lot of pilots measure success by how many procedures were converted, but converting documents is not the same as people using them. The conversion count is attractive because it is easy to report and it goes up steadily every week, so it ends up in the steering committee slides, while the harder question of whether anyone in the field is actually running a job from the tablet gets much less attention until someone asks it near the end of the pilot.
If the procedures are just PDFs on a tablet, or if they are hard to find, slow to open or missing from the jobs people actually do, the count goes up while field use stays flat. Operators make a quick judgement about whether the tablet makes their job easier, and if scrolling a scanned document with gloves on is slower than flipping a laminated page, or if the procedure for today’s job is not there, they go back to paper and the pilot quietly loses its audience.
Pilots that work usually start with a specific crew and a specific set of jobs, measure whether those jobs are being run from the digital procedure and fix whatever is getting in the way. That means choosing a crew with a supervisor who is willing to back it, picking jobs that happen often enough to build habits and spending time in the field watching how people use the device, since problems like poor signal in one building or a login that times out are rarely visible from the office.
Usage at the equipment is the number that tells you whether a pilot is working, and it is the one that gets a rollout approved. The useful measures are things like the share of the selected jobs completed in the digital procedure, how many steps were recorded at the time they were done rather than filled in afterwards and what operators say about whether it saved them time, all of which give leadership a far clearer picture than a conversion total.
A pilot that stalls is often treated as a sign that the crew resisted change, when the real cause is usually something specific and fixable, such as a missing procedure, a clumsy step format or a device that is not charged at the start of shift. Keeping a short list of these blockers, reviewing it weekly with the crew and showing them what was fixed builds the kind of trust that turns a pilot into a habit.
