Abstract
Data are being continuously generated from various operational steps in the oil and gas industry. The recordings of these data and their proper utilization have become a major concern for the oil and gas industry. Decision making based on predictive as well as inferential data analytics helps in making accurate decisions within a short period of time. In spite of many challenges, the use of data analytics for decision making is increasing on a large-scale in the oil and gas industry. An appreciable amount of development has been done in the above area of research. Many complex problems may now be easily solved using Artificial Intelligence (AI) and Machine Learning (ML) techniques. Historical, as well as real-time data, can be assimilated to achieve higher production by gathering data from the gas/oil wells. Various analytical modeling techniques are now widely being used by the oil and gas sector to make a decision based on data analytics. This paper reviews the recent developments via applications of AI and ML techniques for efficient exploitation of the data obtained, starting from the exploration for crude oil to the distribution of its end products. A brief account of the acceptance and future of these techniques in the oil and gas industry is also discussed. Present work may provide a technical framework for choosing relevant technologies for effectively gaining the information from the large volume of data generated by the oil and gas industry.
Similar content being viewed by others
Availability of data and materials
Data available on request from the authors.
Abbreviations
- ARE:
-
Absolute Relative Error
- ANN:
-
Artificial Neural Network
- BDMT:
-
Big Data Methods and Tools
- BHP:
-
Bottom Hole Pressure
- BNN:
-
Bayesian Belief Network
- DT:
-
Decision Tree
- E&P:
-
Exploration and Production
- EOR:
-
Enhanced Oil Recovery
- ESP:
-
Electrical Submersible Pump
- FL:
-
Fuzzy Logic
- GA:
-
Genetic Algorithm
- GBM:
-
Gradient Boosting Machine
- LR:
-
Linear Regression
- NDT:
-
Neural Decision Tree
- MPD:
-
Measured Pressure Drilling
- MSE:
-
Mean Squared Error
- PCA:
-
Principal Component Analysis
- PNN:
-
Probabilistic Neural Network
- PVT:
-
Pressure Volume Temperature
- RF:
-
Random Forest
- SVM:
-
Support Vector Machine
- SVR:
-
Support Vector Regression
References
Accenture Consulting (2016) The 2016 oil and gas digital trends survey. Available from https://www.accenture.com/gb-en/insight-2016-upstream-oil-gas-digital-trends-survey
Agwu OE, Akpabio JU, Alabi SB, Dosunmu A (2018) Artificial intelligence techniques and their applications in drilling fluid engineering: a review. J Pet Sci Eng 167:300–315
Akande KO, Owolabi TO, Olatunji SO, AbdulRaheem A (2017) A hybrid particle swarm optimization and support vector regression model for modeling permeability prediction of hydrocarbon reservoir. J Pet Sci Eng 150:43–53
Al-Anazi AF, Gates ID (2012) Support vector regression to predict porosity and permeability: effect of sample size. Comput Geosci 39:64–76
Alhashem M (2019, November) Supervised machine learning in predicting multiphase flow regimes in horizontal pipes. In Abu Dhabi international petroleum exhibition & conference. Society of Petroleum Engineers
Ali SS, Nizamuddin S, Abdulraheem A, Hassan MR, Hossain ME (2013) Hydraulic unit prediction using support vector machine. J Pet Sci Eng 110:243–252
Al-Yami AS, Al-Shaarawi A, Al-Bahrani H, Wagle VB, Al-Gharbi S, Al-Khudiri MB (2016, December) Using Bayesian network to develop drilling expert systems. In SPE heavy oil conference and exhibition. Society of Petroleum Engineers
Aminian K, Ameri S, Oyerokun A, Thomas B (2003, January) Prediction of flow units and permeability using artificial neural networks. In SPE western regional/AAPG Pacific section joint meeting. Society of Petroleum Engineers
Anifowose F, Labadin J, Abdulraheem A (2015) Improving the prediction of petroleum reservoir characterization with a stacked generalization ensemble model of support vector machines. Appl Soft Comput 26:483–496
Attia M, Abdulraheem A, Mahmoud MA (2015, September) Pressure drop due to multiphase flow using four artificial intelligence methods. In SPE North Africa technical conference and exhibition. Society of Petroleum Engineers
Aulia A, Rahman A, Quijano Velasco JJ (2014, April) Strategic well test planning using random forest. In SPE intelligent energy conference & exhibition. Society of Petroleum Engineers
Baaziz A, Quoniam L (2014) How to use Big Data technologies to optimize operations in Upstream Petroleum Industry. arXiv preprint arXiv:1412.0755
Balaji K, Rabiei M, Suicmez V, Canbaz CH, Agharzeyva Z, Tek S, Bulut U, Temizel C (2018, June) Status of data-driven methods and their applications in oil and gas industry. In SPE Europe featured at 80th EAGE conference and exhibition. Society of Petroleum Engineers
Ball K, Arbus T, Odi U, Sneed J (2017, September) The rise of the machines, analytics, and the digital oilfield: artificial intelligence in the age of machine learning and cognitive analytics. In Unconventional resources technology conference, Austin, Texas, 24–26 July 2017 (pp 410–418). Society of Exploration Geophysicists, American Association of Petroleum Geologists, Society of Petroleum Engineers
Behnoud FP, Hosseini P, Azizi A (2017) Permeability determination of cores based on their apparent attributes in the Persian Gulf region using Navie Bayesian and Random forest algorithms. J Nat Gas Sci Eng 37:52–68
Bhandari J, Abbassi R, Garaniya V, Khan F (2015) Risk analysis of deep-water drilling operations using Bayesian network. J Loss Prev Process Ind 38:11–23
Bravo CE, Saputelli L, Rivas F, Pérez AG, Nickolaou M, Zangl G, De Guzmán N, Mohaghegh SD, Nunez G (2014) State of the art of artificial intelligence and predictive analytics in the E&P industry: a technology survey. SPE J 19(04):547–563
Cai B, Liu Y, Liu Z, Tian X, Dong X, Yu S (2012) Using Bayesian networks in reliability evaluation for subsea blowout preventer control system. Reliabil Eng Syst Saf 108:32–41
Camps-Valls G (2011, October) Support vector machines in remote sensing: the tricks of the trade. In Image and signal processing for remote sensing XVII (vol 8180, p 81800B). International Society for Optics and Photonics
Canning A, Moulière-Reiser D, Weiss Y, Malkin A, Phillip E, Grinberg N, Teitel A, Reznikov M, Yehezkel V (2017) Neural networks approach to spectral enhancement. In SEG technical program expanded abstracts 2017 (pp 4283–4286). Society of Exploration Geophysicists
Chamkalani A, Zendehboudi S, Chamkalani R, Lohi A, Elkamel A, Chatzis I (2013) Utilization of support vector machine to calculate gas compressibility factor. Fluid Phase Equilib 358:189–202
Chang Y, Chen G, Wu X, Ye J, Chen B, Xu L (2018) Failure probability analysis for emergency disconnect of deep-water drilling riser using Bayesian network. J Loss Prev Process Ind 51:42–53
Cowles D (2015) Oil, gas, and data: high-performance data tools in the production of industrial power. Available from https://www.oreilly.com/ideas/oil-gas-data
Cranganu C, Breaban M (2013) Using support vector regression to estimate sonic log distributions: a case study from the Anadarko Basin, Oklahoma. J Pet Sci Eng 103:1–13
Dargahi-Zarandi A, Hemmati-Sarapardeh A, Hajirezaie S, Dabir B, Atashrouz S (2017) Modeling gas/vapor viscosity of hydrocarbon fluids using a hybrid GMDH-type neural network system. J Mol Liq 236:162–171
Deloitte Analysis Report (2019) Digital transformation of oil and gas sector. Available from https://www.petrotech.in/static/pdf/Theme-Session-Deloitte.pdf
Devold H, Graven T, Halvorsrød SO (2017, May) Digitalization of oil and gas facilities reduce cost and improve maintenance operations. In Offshore Technology Conference. Offshore Technology Conference
Di QF, Hua S, Ding WP, Gong W, Cheng YC, Ye F (2015) Application of support vector machine in drag reduction effect prediction of nanoparticles adsorption method on oil reservoir’s micro-channels. J Hydrodyn 27(1):99–104
Ebrahimi A, Khamehchi E (2016) Developing a novel workflow for natural gas lift optimization using advanced support vector machine. J Nat Gas Sci Eng 28:626–638
El-Sebakhy EA (2009) Forecasting PVT properties of crude oil systems based on support vector machines modeling scheme. J Pet Sci Eng 64(1–4):25–34
Fatehi M, Asadi HH (2017) Data integration modeling applied to drill hole planning through semi-supervised learning: a case study from the Dalli Cu-Au porphyry deposit in the central Iran. J Afr Earth Sci 128:147–160
Gharagheizi F, Mohammadi AH, Arabloo M, Shokrollahi A (2017) Prediction of sand production onset in petroleum reservoirs using a reliable classification approach. Petroleum 3(2):280–285
Ghoraishy SM, Liang JT, Green DW, Liang HC (2008, January) Application of Bayesian networks for predicting the performance of gel-treated wells in the Arbuckle formation, Kansas. In SPE symposium on improved oil recovery. Society of Petroleum Engineers
Gu B, Kania R, Gao M, Feil WH (2005, January) Development of SCC susceptibility model using a decision tree approach. In CORROSION 2005. NACE International
Guo D, Raghavendra CS, Yao KT, Harding M, Anvar A, Patel A (2015, April) Data driven approach to failure prediction for electrical submersible pump systems. In SPE western regional meeting. Society of Petroleum Engineers
Gupta S, Nikolaou M, Saputelli L, Bravo C (2016, September). ESP health monitoring KPI: a real-time predictive analytics application. In SPE intelligent energy international conference and exhibition. Society of Petroleum Engineers
Hajirezaie S, Hemmati-Sarapardeh A, Mohammadi AH, Pournik M, Kamari A (2015) A smooth model for the estimation of gas/vapor viscosity of hydrocarbon fluids. J Nat Gas Sci Eng 26:1452–1459
Hajirezaie S, Pajouhandeh A, Hemmati-Sarapardeh A, Pournik M, Dabir B (2017) Development of a robust model for prediction of under-saturated reservoir oil viscosity. J Mol Liq 229:89–97
Hamzeh H (2016) Application of big data in petroleum industry. Department of Electronics and Computer Engineering Istanbul Sehir University hamedhamzeh@std.sehir.edu.tr
Hassani H, Silva ES (2018) Big Data: a big opportunity for the petroleum and petrochemical industry. OPEC Energy Rev 42(1):74–89
Hemmati-Sarapardeh A, Hajirezaie S, Soltanian MR, Mosavi A, Nabipour N, Shamshirband S, Chau KW (2020) Modeling natural gas compressibility factor using a hybrid group method of data handling. Eng Appl Comput Fluid Mech 14(1):27–37
Jia X, Zhang F (2016, September) Applying data-driven method to production decline analysis and forecasting. In SPE Annual technical conference and exhibition. Society of Petroleum Engineers
Kar S, Das S, Ghosh PK (2014) Applications of neuro fuzzy systems: a brief review and future outline. Appl Soft Comput 15:243–259
Kormaksson M, Vieira MR, Zadrozny B (2015, March) A data driven method for sweet spot identification in shale plays using well log data. In SPE digital energy conference and exhibition. Society of Petroleum Engineers
Lantham A (2019) Why explorers are in the grip of an existential crisis: exploration’s role to undergo profound change as energy transition gains pace. Wood Machenzie, Society of Petroleum Engineers
Lee LH, Rajkumar R, Lo LH, Wan CH, Isa D (2013) Oil and gas pipeline failure prediction system using long range ultrasonic transducers and Euclidean-Support Vector Machines classification approach. Expert Syst Appl 40(6):1925–1934
Li X, Chan CW, Nguyen HH (2013) Application of the Neural Decision Tree approach for prediction of petroleum production. J Pet Sci Eng 104:11–16
Li X, Miskimins JL, Sutton RP, Hoffman BT (2014, October) Multiphase flow pattern recognition in horizontal and upward gas-liquid flow using support vector machine models. In SPE annual technical conference and exhibition. Society of Petroleum Engineers
Liu X, Zheng J, Fu J, Nie Z, Chen G (2018) Optimal inspection planning of corroded pipelines using BN and GA. J Pet Sci Eng 163:546–555
Mask G, Wu X, Ling K (2019, March) An improved model for gas-liquid flow pattern prediction based on machine learning. In International petroleum technology conference. International Petroleum Technology Conference
Masoudi P, Tokhmechi B, Jafari MA, Zamanzadeh SM, Sherkati S (2012) Application of Bayesian in determining productive zones by well log data in oil wells. J Pet Sci Eng 94:47–54
Maucec M, Garni S (2019, March) Application of automated machine learning for multi-variate prediction of well production. In SPE middle east oil and gas show and conference. Society of Petroleum Engineers
Mesbah M, Soroush E, Rezakazemi M (2017) Development of a least squares support vector machine model for prediction of natural gas hydrate formation temperature. Chin J Chem Eng 25(9):1238–1248
Mittal A, Slaughter A, Zonneveld P (2017) Protecting the connected barrels. Cyber Security for Upstream Oil and Gas. Available from https://www2.deloitte.com/insights/us/en/industry/oil-and-gas/cybersecurity-in-oil-and-gas-upstream-sector.html
Mohaghegh SD (2017) Shale analytics: data-driven analytics in unconventional resources. Springer
Mohammadpoor M, Torabi F (2018) Big Data analytics in oil and gas industry: an emerging trend. Petroleum
Noshi CI, Schubert JJ (2018, October) The role of machine learning in drilling operations; A review. Society of Petroleum Engineers. https://doi.org/10.2118/191823-18ERM-MS
Noshi CI, Assem AI, Schubert JJ (2018, December) The role of big data analytics in exploration and production: a review of benefits and applications. In SPE international heavy oil conference and exhibition. Society of Petroleum Engineers
Rahmanifard H, Plaksina T (2018) Application of artificial intelligence techniques in the petroleum industry: a review. Artif Intell Rev, pp 1–24
RGU (2016) Intertek and RGU make the most of big data. Available from http://www.rgu.ac.uk/news/intertek-and-rgu-make-the-most-of-big-data
Ross C (2017) Improving resolution and clarity with neural networks. In SEG technical program expanded abstracts 2017 (pp 3072–3076). Society of Exploration Geophysicists
Saputelli L (2016) Technology focus: petroleum data analytics. J Pet Technol 68(10):66–66
Saputelli L, Nikolaou M, Economides MJ (2003, January) Self-learning reservoir management. In SPE annual technical conference and exhibition. Society of Petroleum Engineers
Serapiao AB, Tavares RM, Mendes JRP, Guilherme IR (2006, November) Classification of petroleum well drilling operations using Support Vector Machine (SVM). In 2006 International conference on computational intelligence for modeling control and automation and international conference on intelligent agents web technologies and international commerce (CIMCA’06) (pp 145–145). IEEE
Shi GR (2008) Superiorities of support vector machine in fracture prediction and gassiness evaluation. Pet Explor Dev 35(5):588–594
Shrivastva C, Al-Mahruqy SH, Mjeni R, Al Kindy S, Hosein F, Al-Busaidi H, Al-Busaidi J, Laronga RJ (2012, January) Optimizing Borehole imaging for tight gas exploration: evolving a go-no go decision tree in tight gas reservoirs of the Sultanate of Oman. In SPE middle east unconventional gas conference and exhibition. Society of Petroleum Engineers
Sule I, Khan F, Butt S, Yang M (2018) Kick control reliability analysis of managed pressure drilling operation. J Loss Prev Process Ind 52:7–20
Tan M, Song X, Yang X, Wu Q (2015) Support-vector-regression machine technology for total organic carbon content prediction from wireline logs in organic shale: a comparative study. J Nat Gas Sci Eng 26:792–802
Technavio (2015) How oil and gas is using Big Data for better operations. Available from http://www.technavio.com/blog/how-oil-and-gas-using-big-data-better-operations
Temizel C, Nabizadeh M, Kadkhodaei N, Ranjith R, Suhag A, Balaji K, Dhannoon D (2017, May) Data-driven optimization of injection/production in waterflood operations. In SPE intelligent oil and gas symposium. Society of Petroleum Engineers
Tohidi-Hosseini SM, Hajirezaie S, Hashemi-Doulatabadi M, Hemmati-Sarapardeh A, Mohammadi AH (2016) Toward prediction of petroleum reservoir fluids properties: a rigorous model for estimation of solution gas-oil ratio. J Nat Gas Sci Eng 29:506–516
Verma S, Roy A, Perez R, Marfurt KJ (2012) Mapping high frackability and high TOC zones in the Barnett Shale: supervised probabilistic neural network vs. unsupervised multi-attribute Kohonen SOM. In SEG technical program expanded abstracts 2012 (pp 1–5). Society of Exploration Geophysicists
Worthington PF (2005, January) The application of cutoffs in integrated reservoir studies. In SPE annual technical conference and exhibition. Society of Petroleum Engineers
Wu WS, Yang CF, Chang JC, Château PA, Chang YC (2015) Risk assessment by integrating interpretive structural modeling and Bayesian network, case of offshore pipeline project. Reliabil Eng Syst Saf 142:515–524
Zerafat MM, Ayatollahi S, Mehranbod N, Barzegari D (2011, January) Bayesian network analysis as a tool for efficient EOR screening. In SPE enhanced oil recovery conference. Society of Petroleum Engineers
Zhang L, Wu S, Zheng W, Fan J (2018) A dynamic and quantitative risk assessment method with uncertainties for offshore managed pressure drilling phases. Saf Sci 104:39–54
Funding
None.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Choubey, S., Karmakar, G.P. Artificial intelligence techniques and their application in oil and gas industry. Artif Intell Rev 54, 3665–3683 (2021). https://doi.org/10.1007/s10462-020-09935-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10462-020-09935-1