Mobile Data Collection in Oil and Gas: Sector Case Studies

Key Takeaways

 

1. The oil and gas sector is a critical pillar of the global economy, responsible for powering industries, transportation, and electricity generation worldwide.
2. It involves the exploration, extraction, refining, and distribution of petroleum products and natural gas.
3. Despite facing challenges such as fluctuating oil prices and the transition to renewable energy, the sector remains crucial, continuously evolving with advancements in technology.
4. Mobile tools and other data collection technologies have streamlined sector operations by enabling real-time monitoring, predictive maintenance, and more efficient resource management.
5. The article showcases how diverse oil and gas organizations have effectively implemented mobile data collection in their projects.

 

Also read: Mobile Data Collection in Gender and Youth Programs: Social Service Success Stories

 

 

What is Mobile Data Collection?

Mobile Data Collection refers to the use of mobile devices, such as smartphones and tablets to record, store, and relay data in real-time for analysis.

This approach has streamlined data collection and overall information management processes, as opposed to manual paper-based collection methods.

Mobile tools are complemented by other modern data collection tools such as drones to expand coverage of projects in rural and remote regions of the world.

 

 

Mobile data collection has streamlined the oil and gas sector operations by enabling real-time monitoring and more efficient resource management. Picture/Courtesy

How Does Mobile Data Collection Work?

Here is a step-by-step breakdown of how mobile data collection works, along with some of the tools used at each stage of the process:

 

1. Designing Flexible Digital Forms

Oil and gas professionals can use survey authoring tools to create flexible digital forms that capture diverse data, from text and GPS coordinates to barcodes, images, and voice recordings.

These tools assist in designing, testing, and deploying digital forms efficiently.

Some mobile tools used in form design include:

 

1. XLSForms – Excel-based form design standard used by ODK, KoboToolbox, and CommCare.
2. ODK Build – Drag-and-drop form designer for ODK users.
3. Kobo Form Builder – Simplified visual form creator for KoboToolbox.
4. SurveyCTO Designer – Enterprise-grade form-building with conditional logic.
5. Google Forms – Basic web-based form creation tool.
6. Magpi Forms – Mobile-friendly form designer for surveys and data collection.

 

2. Data Collection on Mobile Devices

Oil and gas project managers, field technicians, and other professionals in the sector use mobile devices to collect data in the field.

Many collection tools support multiple functionalities such as barcode scanning, GPS tracking, image capture, voice-to-text input, digital signatures, and many other functionalities.

Mobile data collection tools offer offline functionality, allowing users to capture data even without an internet connection and synchronize it later when connectivity is restored.

Some of the tools used to collect data using mobile devices include:

 

1. ODK Collect – Open-source mobile app for mobile data collection using ODK. ODK Collect can collect data offline.
2. KoboCollect – Mobile app for data collection using KoboToolbox.
3. SurveyCTO Collect – Secure, offline-first data collection platform.
4. Survey123 by Esri – GIS-enabled app for geospatial data collection.
5. CommCare – Mobile case management tool used in health and humanitarian projects.
6. TaroWorks – Salesforce-integrated data collection tool.
7. Magpi+ – Supports multimedia data input.
8. Dimagi CommCare – Supports longitudinal tracking and case management.

 

 

Mobile data collection tools store data offline and sync it automatically once online. Picture/Courtesy

 

3. Offline Data Collection Without Internet Access

Mobile data collection tools facilitate uninterrupted work, even without internet access, by storing data offline and automatically syncing it when a connection is available.

Some of the mobile tools for offline data collection include:

 

1. ODK Collect – Stores responses offline and syncs later to a cloud server.
2. KoboCollect – Stores responses offline and syncs later to a cloud server.
3. Magpi+ – Designed for low-bandwidth regions.
4. TaroWorks – Works offline and syncs with Salesforce CRM.
5. CommCare – Enables offline case tracking for healthcare and NGOs.
6. Surveys on Tab – Offline-first solution for market and corporate surveys.

 

4. Data Synchronization: Uploading & Syncing to the Cloud

Mobile data collection tools automatically upload recorded data to a centralized cloud or on-premise servers for processing as soon as an internet connection is established.

Some of the mobile tools for data synchronization include:

 

1. ODK Central – Store and manage synchronized data.
2. ODK Aggregate – Store and manage synchronized data.
3. KoboToolbox Servers – Store and manage synchronized data.
4. Google Sheets API – Auto-syncs data to spreadsheets for easy access.
5. RedCap – Secure data management for research and healthcare projects.
6. ODK Cloud, Microsoft Azure, AWS S3, Digital Ocean, Google Cloud – Secure cloud-based data storage solutions.

 

Data in oil and gas optimizes exploration, production, and distribution, driving efficiency and reducing risks. Picture/Courtesy

 

 

5. Data Management: Cleaning, Processing, and Storage

Once collected, the data needs to be cleaned, processed, and organized to facilitate analysis and informed decision-making.

Some of the tools for data management include:

 

1. Microsoft Excel & Google Sheets – Used for basic data cleaning and filtering.
2. Power BI – Dashboard creation and business intelligence reporting.
3. Python & R – Advanced data processing and analytics.
4. Tableau – Data visualization and storytelling.
5. QGIS – GIS software for geospatial data mapping.
6. Google BigQuery – Cloud-based big data warehousing.

 

 

6. Reporting & Action: Analyzing Data for Decision-Making

With processed data in hand, organizations create reports, visualize key insights, and drive informed decisions.

Some of the tools for reporting & action include:

 

1. Microsoft Power BI – Interactive data visualization and reporting.
2. Google Data Studio – Cloud-based business intelligence platform.
3. Tableau – Advanced analytics and visualization.
4. SPSS & Stata – Statistical tools for complex data analysis.
5. QGIS – GIS mapping and spatial analytics.
6. Looker (Google Cloud) – Data-driven business intelligence platform.

 

Although mobile data collection can take time to learn and implement, expert training significantly accelerates the learning process and helps you get up to speed quickly.

 

 

A technician monitors an offshore oil rig in real-time from a laptop computer. Picture/Courtesy

Real-World Examples of the Successful Implementation of Mobile Data Collection in Oil and Gas

 

The following notable oil and gas sector projects demonstrate the use of mobile data collection for efficient project management and decision-making:

 

1. Using Open Data Kit (ODK) for Household Surveys in Nigeria’s Gas-Flaring and Non-Oil Communities

Oil exploration and mining is a major economic activity in Nigeria’s Niger Delta, sustaining the livelihoods of millions of people.

Amid the massive profits from the oil trade, the region has seen severe environmental degradation and persistent social conflict.

The region’s complex ecosystem and dense population have been heavily impacted by oil spills, gas flaring, and inadequate infrastructure development.

A household survey was conducted in the Niger Delta region of Nigeria, comparing health outcomes in gas-flaring versus non-oil communities.

Gas flaring refers to the burning of natural gas that’s associated with oil extraction. When crude oil is extracted from the earth, natural gas often comes up with it. This is called “associated gas.”

 

Project Details

 

1.  Between April and May 2016, a group of researchers from the University of Port Harcourt conducted a study across 601 households and 1706 individuals in three states within the Niger Delta.
2. The study was supported by the World Health Organization (WHO).
3. ODK was used to efficiently record primary data, improving the study’s data collection phase.
4. The adoption of ODK was a strategic move to enhance data quality and management in resource-limited settings.

Challenges Before the Adoption of ODK

 

1. Manual data entry often resulted in inaccuracies and inconsistencies.
2. The manual transfer of data into databases was slow and prone to errors, requiring significant resources for data cleaning.
3. Paper-based methods incurred high costs for printing and storage.

Amid the massive profits from the oil trade, Niger Delta has been heavily impacted by oil spills, gas flaring, and inadequate infrastructure development. Picture/Courtesy

 

 

Key Benefits After ODK Adoption

 

1. ODK allowed for real-time data capture, reducing human error and improving data integrity.
2. The estimated cost of using ODK was much lower than what was spent on paper-based methods.
3. Data collection times per household and individual were notably reduced, enhancing overall survey productivity.
4. Residents of the gas-flaring and non-oil communities’ health outcomes were assessed to inform policy recommendations.

Source

Using Android and Open Data Kit Technology in Data Management for Research in Resource-Limited Settings in the Niger Delta Region of Nigeria: Cross-Sectional Household Survey – National Library of Medicine

 

 

2. Drone Technology for Pipeline Inspection in the San Joaquin Valley – Chevron Corporation

Chevron Corporation is a major American multinational energy corporation specializing in oil and gas.

Chevron has a strong presence in the San Joaquin Valley California, with over a century of oil and gas extraction, notably in fields like Coalinga and Midway-Sunset.

The company utilizes cutting-edge technologies to monitor and maintain the integrity of its pipelines.

 

Project Details

 

1. Chevron received US Federal Aviation Administration (FAA) approval in April 2024 to use AiRanger drones for pipeline inspection in the San Joaquin Valley.
2. The project was implemented in partnership with the specialist company American Aerospace Technologies (AATI).
3. The project aimed to enhance pipeline monitoring, collecting data towards pipeline safety, and improving efficiency in identifying leaks and other structural issues.

 

 

Challenges Before the Adoption of Drones in Oil Pipeline Monitoring 

 

1. Data collection and monitoring efforts with helicopters were limited by weather conditions.
2. Manual paper-based inspections were prone to human error.
3. Helicopters or on-ground crews involved significant safety risks, high costs, and inefficiencies.

An oil plant technician on duty at the San Joaquin Valley in Kern County California. Picture/Courtesy

 

 

 

Key Benefits After the Adoption of Drones

 

1. Drones reduced the need for human personnel to work in hazardous environments, minimizing injury risks.
2. Drones were more cost-effective than helicopters, cutting operational costs for the company.
3. Drones provide real-time data, allowing for quicker detection of issues and better decision-making.
4. With advanced imaging technology, drones offer more precise and comprehensive data compared to traditional inspection methods.

 

Source

Drones reducing risk in offshore oil and gas inspection – Offshore Technology

 

3. Using GoFormz Digital Forms for Pipeline Operations Documentation at Overland Pipeline

Overland Pipeline and Energy is a leading American energy company based in Canonsburg, Pennsylvania.

The company operates nationwide in the oil and gas services industry constructing pipelines across different regions in America.

 

Project Details

 

1. Overland Pipeline and Energy, a prominent energy company, adopted GoFormz Digital Forms to enhance the documentation and data capture processes for their pipeline operations.
2. Adopted in 2019, GoFormz Digital Forms streamlined field documentation, replaced paper-based forms, and improved overall workflow efficiency.
3. GoFormz enabled the company to convert paper forms into digital templates, which could be used across mobile devices to collect data in real-time, including GPS coordinates, images, and digital signatures.

 

Challenges Before the Adoption of GoForms in Pipeline Operations

 

1. Data collected from paper forms had to be manually entered into systems, which was time-consuming and prone to errors.
2. The reliance on paper forms slowed down operations, particularly in remote areas where data had to be transferred manually.
3. There was a delay in accessing and analyzing field data, which hampered decision-making and response times.

The GoForms Mobile Data Collection platform helps oil companies document crucial data in real-time, enhancing the safety of oil infrastructure. Picture/Courtesy

 

 

Key Benefits After the Adoption of GoForms

 

1. The digital forms allowed for faster data collection and submission, reducing the time spent on manual paperwork.
2. Overland Pipeline gained immediate access to field data, enabling quicker decision-making and better operational oversight.
3. Automated data capture reduced human errors and inconsistencies typically associated with manual data entry.
4. The shift to digital forms eliminated the costs associated with paper, printing, and physical storage.

Source

GoFormz for oil & gas – GoFormz

 

 

4. Using GIS for Data Collection in Nigeria’s Oil and Gas Industry 

The application of Geographic Information Systems (GIS) in Nigeria’s oil and gas industry has significantly enhanced operational efficiency, pipeline monitoring, and oil exploration.

As the sector flourished, the Nigerian Federal Ministry of Environment and the Department of Petroleum Resources became increasingly concerned about the extent to which drilling wastes may impact the environment.

GIS technology has been leveraged to assess spatial data, monitor environmental impacts, and optimize resource management.

 

Project Details

 

1. GIS was adopted by various Nigerian oil and gas companies in the early 2000s, with significant implementation seen in the mid-2010s.
2. The technology was spearheaded by the Nigerian Federal Ministry of Environment and the Department of Petroleum Resources to monitor the environment from severe impact by oil exploration.
3. This technology was used to capture and manage spatial data related to pipeline routes, oil field operations, and waste disposal areas, providing a more precise understanding of environmental risks.
4. The adoption of GIS was driven by the need for better real-time data collection and decision-making tools.

 

Challenges Before the Adoption of GIS in Oil and Gas Operations in Nigeria

 

1. Manual tracking and mapping were slow, inaccurate, and cumbersome, leading to delays in decision-making and risk assessment.
2. Without precise geographic data, it was difficult to assess and monitor the environmental impact of drilling and waste disposal.
3. Pipeline leaks and other failures were harder to predict and address promptly due to the lack of accurate spatial data and monitoring tools.

 

A rusty gas plant in Nigeria. while Nigeria is a major player in the global oil market, its production has been inconsistent due to pipeline vandalism and other internal issues. Picture/Courtesy

 

 

Key Benefits After the Adoption of GIS Technology

 

1. GIS enabled more effective monitoring of the environment, allowing for the identification of potential environmental risks.
2. GIS technology helped companies monitor pipeline routes and health, leading to early identification of potential leaks and reducing maintenance costs.
3. GIS allowed for real-time data collection in remote areas, which improved decision-making and operational efficiency.
4. GIS helped ensure better adherence to environmental guidelines and standards by providing precise documentation of disposal sites.

Source

A Review of the Application of GIS in the Nigerian Oil and Gas Industry – Journal of Environmental Management and Safety

 

 

Also read: Mobile Data Collection: Unlocking Efficiency in the Energy Sector

 

 

5. Using KoBoToolbox for Fleet Management and Humanitarian Logistics – WeWorld-GVC

WeWorld-GVC is an Italian independent organization that focuses on development cooperation and humanitarian aid.

The organization works to improve the lives of girls, boys, women, and youth, striving for a fairer and more inclusive world.

 

Project Details

 

1. WeWorld-GVC adopted KoboToolbox to streamline fleet management and optimize logistics operations in Burundi.
2. The organization manages a fleet of 30 vehicles and 35 motorbikes to support humanitarian projects focused on water, nutrition, socio-economic development, and health.
3. KoboToolbox was specifically implemented to enhance data collection, especially for fleet fueling and maintenance records.
4. Introduced in 2022, KoBoToolbox replaced the paper-based data collection system that had previously been used for fleet management.

Challenges Before KoboToolbox Adoption

 

1. Fleet information was recorded manually, requiring significant time for data entry, validation, and analysis.
2. Manual methods increased the risk of data errors, affecting decision-making and leading to inefficiencies.
3. Data was not available in real-time, delaying insights into fleet performance and fuel usage, especially during fuel shortages.

 

A section of the infamous Burundian highway cyclists known for their dangerous antics on the roads cling on a moving truck. Picture/Courtesy

 

 

Key Benefits After the Adoption of Mobile Data Collection

 

1. It allowed for immediate data capture, providing the logistics team with real-time visibility into fleet usage, fuel consumption, and maintenance issues.
2. The use of digital forms reduced errors, and the automated data collection process saved time and resources, allowing for quicker decision-making.
3. The ability to collect data offline and submit it later was crucial in remote areas with unreliable internet access.
4. Data from KoboToolbox was integrated with Power BI, enabling the creation of dashboards for better fleet performance tracking.

 

 

Source

How WeWorld-GVC is using KoboToolbox to enhance fleet management and humanitarian logistics in Burundi – KoBoToolbox.org

Conclusion

Mobile data collection tools, such as GoFormz and KoboToolbox, have streamlined field data gathering by reducing errors, speeding up processes, and providing real-time access to crucial information.

 

The integration of mobile data collection tools, drones, and Geographic Information Systems (GIS) has also had a profound impact on the oil and gas sector, revolutionizing how companies manage operations, monitor environmental risks, and improve overall efficiency.

 

Drones, with their ability to provide aerial surveillance and real-time data, have transformed pipeline inspections and environmental monitoring, reducing risks to human workers and improving safety.

 

This enables better decision-making and operational oversight, resulting in cost savings and increased productivity.

 

The combination of real-time data collection, advanced monitoring capabilities, and geographic analysis equips the industry with the tools needed to adapt to modern challenges and improve long-term performance.

 

Post Tags:#Drones#GIS#GoForms#KoBoToolBox#ODK