At opposite ends of Illinois, two leaders in emerging construction technologies are collaborating to demonstrate how AI, ML (machine learning) and CV (computer vision) can validate constructions digital-data mandate: Save time, save money, save lives.
For the fourteenth consecutive year, U.S. construction valuation has grown and is now at $1.98 trillion, noted Mani Golparvar, professor of civil engineering, computer science and technology entrepreneurship at the Grainger College of Engineering/University of Illinois. But, hes reported, 53% of construction projects are behind schedule, 66% are over budget and nearly all carry cost overruns.
Golparvar estimated that $280 billion in potential added value exists through improved coordination. As an industry, weve significantly improved the way we plan projects. But the way we plan the job, execute, monitor our execution and use whatever we monitor to update a planthese four problems all contribute to why projects are behind schedule and over budget. If youre looking to these issues, 80% are preventable: Project team members do not have visibility early enough to be able to come up with a remedy.
To that end, Golparvar is founder and chief strategy officer of Reconstruct, a Visual Command Center that uploads schedules, 2D and 3D models, and reality capture so users can track progress as well as coordination and communications problems. Reconstruct says its benefits include a 30% reduction in time reporting field progress, and 25%-40% in improved schedule management and proactive risk mitigation. Eighty-five companies and several universities now partner with it.
Burcin Kaplanoglu mirrored Golparvars remarks. Speaking from the Oracle Industry Lab he heads just outside Chicago, he noted that U.S. infrastructure is graded as a C- by the American Society of Civil Engineers. At the same time, he said, we [would] need to hire 500,000 people a year, on top of regular hiring, to meet demand.
Consequently, he added, we need to automate processes, gain efficiency and improve safety with technology. Talking to your data is going to have tremendous benefits for the construction engineer. Getting that response really quickly is going to change how we interact with technology.
Golparvar and Kaplanoglu recently joined forces around a Reality Mapping Experiment (see Constructing the Future sidebar, pg. 46) at the Oracle lab to explore what combination of tools, processes and teams can best conduct reality capture and mapping on-site, reducing time and cost and ensuring safety.
Thats of great value to an industry facing an ever-growing tech stack, as Jennifer Suerth, senior vice president of Pepper Construction, which built the lab, said in an Oracle TV video. Autonomy allows us to continue to get the work done but be efficient with the resources we have.
Golparvar and Kaplanoglu offered quick definitions of ML, CV and AI.
Machine learning allows computers to learn from data to improve and streamline processes. Machine learning is continuing to improve the construction industry, Kaplanoglu said. We need to figure out how to optimize and how to forecast better.
Computer vision is a form of AI, Golparvar said. It involves the process of analyzing pictures and videos and generating actionable insights from them, doing image processing and understanding the geometry of the scene. Recognizing objects by automatically analyzing them can track progress, detect and recognize anomalies, and coordinate and optimize operations.
To solve that coordination issue requires everyone to be on the same page in terms of what was there versus what should be there, Golparvar continued. In construction, weve really taken advantage of design information that we call BIM, building information models, 3D representation of design. What if you tie them against the schedule? At any snapshot in time, you can click on any two points, you can measure the length, area and volume. The picture shows you what was promised to be done; the picture in the background shows you what has been achieved on the job. And the delta between the twowhat needs to be coordinated in terms of quality, safety and progresscan be color-coded in red and green: what is on the schedule, what is behind.
Generative AI is the third leg of this digital triad. AI involves machines mimicking human cognitive functions, but theres more to that than large language models. GenAI is going to help us do project management and planning, Kaplanoglu said. AI can inform the entire construction cycle, from estimating preliminary costs, to tracking quality and productivity, to the more tactical tasks of ordering and payment.
Kaplanoglu ventured predictions for AI, ML and CV in construction:
Unified, intelligent clouds will unite software, platforms and infrastructure within end-to-end solutions, easing management and accelerating change.
Oracle is a major player in the world of project management and design, and in 2018 Kaplanoglu co-founded the Oracle Industry Lab to advance the companys innovation in construction and engineering. He explained the rationale. When youre running day-to-day operations, its very hard to stop what youre doing and try these new technologies. So, by creating a testbed where we bring the technology and they bring their problems, we are creating a neutral space to try and learn from it.
To realize this, writing a data strategy around machine learning was followed by building an ecosystem because our products do scheduling, safety, risk management, cost. We had almost 2,000 engagements in the first two years, he said. The pandemic only spurred a concentration on autonomy. All of a sudden, we did remote site monitoring, cameras and drone flights, route inspections. We could work with architects and designers remotely; they didnt have to come to the site. Everything was video.
The original sandbox gave way to a much larger, industry-benchmarking construction space for investigatingrealistic job site situations. It opened in April 2022on time, on budget. With analogs now operating in the United Kingdom and Australia, it has passed 13,000 engagements. I think construction really got used to digital imagery, 3D point clouds, using drones, capturing data, Kaplanoglu said.
Construction has some relatively unique characteristics, from a constantly changing environment to wind and weather exposure. Its like building a prototype each time, Kaplanoglu added. Data can bridge that. For example, Komatsu, the massive construction and mining equipment manufacturer, is using Nvidias Jetson edge AI platform to impart intelligence to trucks, excavators and the like. AI and machine learning are critical to providing real value to the construction space, a Nvidia spokesman toldInside Unmanned Systems.
In terms of project management, Kaplanoglu said, theres tons of opportunities when we want to use machine learning, computer vision and GenAI.
The need to test construction innovation, validation and measurement in real-world situations led to a collaboration between Oracles. Smart Construction Platform ecosystem and founding partner tenant Reconstructs visualization tools. The goal was to create guidelines and tool utilizations best suited for particular use cases, improving documentation of and guidelines for progress, quality and assessment of as-built conditions through a structures lifecycle.
The Report explains costs, time spent on different tools, and what kind of results you should be expecting from each, Golparvar explained about the 2023 document.
Pepper Construction and Clayco offered project expertise on the construction side, with leading drone company Skydio and 3D measurement company FARO Technologies providing technical expertise.
Eight different ways of capturing and mapping data were scanned across resolutions, speed, cost and deliverables. These included manual and autonomous drones, 360 and smartphone cameras, and various stationary and mobile LiDAR techniques. Capture data was processed into Oracles platform and then into Reconstruct, which could process them for a consistent viewing experience. Post-processing, photogrammetry and 4D simulations could be viewed for actionable and exportable results.
Construction is said to be the number one civil market for drones, which can take pictures quickly in hard-to-access areas while their sensors allow for obstacle avoidance. For the experiment, a fully autonomous Skydio drone used its Indoor Capture vision-based autonomous software over several iterations to, as Solutions Engineering Manager Colin Romberger put it on Oracle TV, get total coverageto have the best data to put into photogrammetry software for Reconstruction.
Kaplanoglu discussed gains from using autonomous drones. The time savings dropped significantly, because youre already preprogrammed. Human drone flights also improved with repetition. Theres still some autonomy, like it avoids obstacles and you can do flight plans.
But the biggest drop happens when its fully autonomous.
You always want to know about what youre trying to solve, what kind of tools you have and what kind of resources you can leverage to solve that problem, Golparvar said.
He and Kaplanoglu enumerated how AI and associated technologies can self-direct and break down planning and actions.
Site selection already involves machine learning, Kaplanoglu said, because you have certain parameters to make sure you comply with, like height restrictions, zoning. You can use machine learning to pick the optimal location.
Design can use machine learning to investigate bigger datasets and find helpful patterns. Golparvar: You want to capture the architects intent and transform it into a document that can be used as a base of design. GenAI can provide and reconcile design alternatives, incorporating everything from routing mechanical systems to complying with local codes. The way it works, Kaplanoglu added, you sketch things and then people try to visualize it and build models. Learning from them can offer significant time savings. Im talking about doing this in an hour versus doing it in months.
Construction has its own mini cycle. You define your scope, you hire engineers and architects, and now you need a contractor to build it Kaplanoglu said. You send an RFP for a contractor to build it.
RFPs, however, can be limited and schedulers may cut and paste. Kaplanoglu offered a solution: We can upload an RFP document to Oracle Cloud infrastructure. It reads the document and gives you a summary and then it asks you questions. Its going to show you an early-stage prototype, and it builds a schedule for you. Its going to be a good template for you to build your own schedule.
Now something that would have taken you three days is going to take you maybe two to three hours.
Operations can use computer vision. How many times does someone show up at their location and they dont even know what the specifications are or what theyre supposed to do, Kaplanoglu said. You can take a picture or video and then computer vision can tell you, Its this manufacturer, this model, or vision can process the video or image and say, Oh, theres rust in this corner.
Predictive maintenance can significantly reduce costs and downtime. Safety also can be empowered by AI. Many of the AI tools that we have are completely focusing on offering better awareness for our workers, Golparvar said.
Skydio has participated in the Oracle labs work, and Kaplanoglu offered an example of its drones adding value. We have a great relationship with Skydio. Instead of taking images that humans need to tag, locate and input, that data goes to our product, and then our Vision Services recognizes the rust and registers it to our work order system. But it doesnt just register; it tells you the lat[itude] and long[itude], the location, the severity of the damage, it helps you create a ticket.
Basically, we automate the whole thing.
Imprecise capture, incorrect inputting and lack of updating can undermine results. Still, the industry has significantly improved its use of cloud, Kaplanoglu said. The data is more accessible, you can put more line, compute is easier. There are a lot of benefits to it, and our industry really took that to heart.
Golparvar advocates a step-by-step process. We do a maturity assessment on the readiness of a company for adopting and adapting AI-driven products, and what we can do to make sure that these products fit into the existing workflows. Because people are resistant to change.
We also need to demonstrate the return on investment, at the project level and the individual levelquality, speed, time and money saved. So, the best strategy is to kind of introduce one next step to that project team so we can take them from where they are to that future where many of their steps will be fully automated, and make sure they see how AI is verifiable, to have that element of trust.
Kaplanoglu is bullish in terms of technology adoption. Machine learning, computer vision and GenAI are all going to have a big impact in the next three to five years.
Continued here:
Inside AI: Talking to the Data - Inside Unmanned Systems
- What Is Machine Learning? | How It Works, Techniques ... [Last Updated On: September 5th, 2019] [Originally Added On: September 5th, 2019]
- Start Here with Machine Learning [Last Updated On: September 22nd, 2019] [Originally Added On: September 22nd, 2019]
- What is Machine Learning? | Emerj [Last Updated On: October 1st, 2019] [Originally Added On: October 1st, 2019]
- Microsoft Azure Machine Learning Studio [Last Updated On: October 1st, 2019] [Originally Added On: October 1st, 2019]
- Machine Learning Basics | What Is Machine Learning? | Introduction To Machine Learning | Simplilearn [Last Updated On: October 1st, 2019] [Originally Added On: October 1st, 2019]
- What is Machine Learning? A definition - Expert System [Last Updated On: October 2nd, 2019] [Originally Added On: October 2nd, 2019]
- Machine Learning | Stanford Online [Last Updated On: October 2nd, 2019] [Originally Added On: October 2nd, 2019]
- How to Learn Machine Learning, The Self-Starter Way [Last Updated On: October 17th, 2019] [Originally Added On: October 17th, 2019]
- definition - What is machine learning? - Stack Overflow [Last Updated On: November 3rd, 2019] [Originally Added On: November 3rd, 2019]
- Artificial Intelligence vs. Machine Learning vs. Deep ... [Last Updated On: November 3rd, 2019] [Originally Added On: November 3rd, 2019]
- Machine Learning in R for beginners (article) - DataCamp [Last Updated On: November 3rd, 2019] [Originally Added On: November 3rd, 2019]
- Machine Learning | Udacity [Last Updated On: November 3rd, 2019] [Originally Added On: November 3rd, 2019]
- Machine Learning Artificial Intelligence | McAfee [Last Updated On: November 3rd, 2019] [Originally Added On: November 3rd, 2019]
- Machine Learning [Last Updated On: November 3rd, 2019] [Originally Added On: November 3rd, 2019]
- AI-based ML algorithms could increase detection of undiagnosed AF - Cardiac Rhythm News [Last Updated On: November 19th, 2019] [Originally Added On: November 19th, 2019]
- The Cerebras CS-1 computes deep learning AI problems by being bigger, bigger, and bigger than any other chip - TechCrunch [Last Updated On: November 19th, 2019] [Originally Added On: November 19th, 2019]
- Can the planet really afford the exorbitant power demands of machine learning? - The Guardian [Last Updated On: November 19th, 2019] [Originally Added On: November 19th, 2019]
- New InfiniteIO Platform Reduces Latency and Accelerates Performance for Machine Learning, AI and Analytics - Business Wire [Last Updated On: November 19th, 2019] [Originally Added On: November 19th, 2019]
- How to Use Machine Learning to Drive Real Value - eWeek [Last Updated On: November 19th, 2019] [Originally Added On: November 19th, 2019]
- Machine Learning As A Service Market to Soar from End-use Industries and Push Revenues in the 2025 - Downey Magazine [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- Rad AI Raises $4M to Automate Repetitive Tasks for Radiologists Through Machine Learning - - HIT Consultant [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- Machine Learning Improves Performance of the Advanced Light Source - Machine Design [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- Synthetic Data: The Diamonds of Machine Learning - TDWI [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- The transformation of healthcare with AI and machine learning - ITProPortal [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- Workday talks machine learning and the future of human capital management - ZDNet [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- Machine Learning with R, Third Edition - Free Sample Chapters - Neowin [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- Verification In The Era Of Autonomous Driving, Artificial Intelligence And Machine Learning - SemiEngineering [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- Podcast: How artificial intelligence, machine learning can help us realize the value of all that genetic data we're collecting - Genetic Literacy... [Last Updated On: November 28th, 2019] [Originally Added On: November 28th, 2019]
- The Real Reason Your School Avoids Machine Learning - The Tech Edvocate [Last Updated On: November 28th, 2019] [Originally Added On: November 28th, 2019]
- Siri, Tell Fido To Stop Barking: What's Machine Learning, And What's The Future Of It? - 90.5 WESA [Last Updated On: November 28th, 2019] [Originally Added On: November 28th, 2019]
- Microsoft reveals how it caught mutating Monero mining malware with machine learning - The Next Web [Last Updated On: November 28th, 2019] [Originally Added On: November 28th, 2019]
- The role of machine learning in IT service management - ITProPortal [Last Updated On: November 28th, 2019] [Originally Added On: November 28th, 2019]
- Global Director of Tech Exploration Discusses Artificial Intelligence and Machine Learning at Anheuser-Busch InBev - Seton Hall University News &... [Last Updated On: November 28th, 2019] [Originally Added On: November 28th, 2019]
- The 10 Hottest AI And Machine Learning Startups Of 2019 - CRN: The Biggest Tech News For Partners And The IT Channel [Last Updated On: November 28th, 2019] [Originally Added On: November 28th, 2019]
- Startup jobs of the week: Marketing Communications Specialist, Oracle Architect, Machine Learning Scientist - BetaKit [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- Here's why machine learning is critical to success for banks of the future - Tech Wire Asia [Last Updated On: December 2nd, 2019] [Originally Added On: December 2nd, 2019]
- 3 questions to ask before investing in machine learning for pop health - Healthcare IT News [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Machine Learning Answers: If Caterpillar Stock Drops 10% A Week, Whats The Chance Itll Recoup Its Losses In A Month? - Forbes [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Measuring Employee Engagement with A.I. and Machine Learning - Dice Insights [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Amazon Wants to Teach You Machine Learning Through Music? - Dice Insights [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Machine Learning Answers: If Nvidia Stock Drops 10% A Week, Whats The Chance Itll Recoup Its Losses In A Month? - Forbes [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- AI and machine learning platforms will start to challenge conventional thinking - CRN.in [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Machine Learning Answers: If Twitter Stock Drops 10% A Week, Whats The Chance Itll Recoup Its Losses In A Month? - Forbes [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Machine Learning Answers: If Seagate Stock Drops 10% A Week, Whats The Chance Itll Recoup Its Losses In A Month? - Forbes [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Machine Learning Answers: If BlackBerry Stock Drops 10% A Week, Whats The Chance Itll Recoup Its Losses In A Month? - Forbes [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Amazon Releases A New Tool To Improve Machine Learning Processes - Forbes [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Another free web course to gain machine-learning skills (thanks, Finland), NIST probes 'racist' face-recog and more - The Register [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Kubernetes and containers are the perfect fit for machine learning - JAXenter [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- TinyML as a Service and machine learning at the edge - Ericsson [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- AI and machine learning products - Cloud AI | Google Cloud [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Machine Learning | Blog | Microsoft Azure [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Machine Learning in 2019 Was About Balancing Privacy and Progress - ITPro Today [Last Updated On: December 25th, 2019] [Originally Added On: December 25th, 2019]
- CMSWire's Top 10 AI and Machine Learning Articles of 2019 - CMSWire [Last Updated On: December 25th, 2019] [Originally Added On: December 25th, 2019]
- Here's why digital marketing is as lucrative a career as data science and machine learning - Business Insider India [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- Dell's Latitude 9510 shakes up corporate laptops with 5G, machine learning, and thin bezels - PCWorld [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- Finally, a good use for AI: Machine-learning tool guesstimates how well your code will run on a CPU core - The Register [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- Cloud as the enabler of AI's competitive advantage - Finextra [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- Forget Machine Learning, Constraint Solvers are What the Enterprise Needs - - RTInsights [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- Informed decisions through machine learning will keep it afloat & going - Sea News [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- The Problem with Hiring Algorithms - Machine Learning Times - machine learning & data science news - The Predictive Analytics Times [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- New Program Supports Machine Learning in the Chemical Sciences and Engineering - Newswise [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- AI-System Flags the Under-Vaccinated in Israel - PrecisionVaccinations [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- New Contest: Train All The Things - Hackaday [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- AFTAs 2019: Best New Technology Introduced Over the Last 12 MonthsAI, Machine Learning and AnalyticsActiveViam - www.waterstechnology.com [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Educate Yourself on Machine Learning at this Las Vegas Event - Small Business Trends [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Seton Hall Announces New Courses in Text Mining and Machine Learning - Seton Hall University News & Events [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Looking at the most significant benefits of machine learning for software testing - The Burn-In [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Leveraging AI and Machine Learning to Advance Interoperability in Healthcare - - HIT Consultant [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Adventures With Artificial Intelligence and Machine Learning - Toolbox [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Five Reasons to Go to Machine Learning Week 2020 - Machine Learning Times - machine learning & data science news - The Predictive Analytics Times [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Uncover the Possibilities of AI and Machine Learning With This Bundle - Interesting Engineering [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Learning that Targets Millennial and Generation Z - HR Exchange Network [Last Updated On: January 23rd, 2020] [Originally Added On: January 23rd, 2020]
- Red Hat Survey Shows Hybrid Cloud, AI and Machine Learning are the Focus of Enterprises - Computer Business Review [Last Updated On: January 23rd, 2020] [Originally Added On: January 23rd, 2020]
- Vectorspace AI Datasets are Now Available to Power Machine Learning (ML) and Artificial Intelligence (AI) Systems in Collaboration with Elastic -... [Last Updated On: January 23rd, 2020] [Originally Added On: January 23rd, 2020]
- What is Machine Learning? | Types of Machine Learning ... [Last Updated On: January 23rd, 2020] [Originally Added On: January 23rd, 2020]
- How Machine Learning Will Lead to Better Maps - Popular Mechanics [Last Updated On: January 30th, 2020] [Originally Added On: January 30th, 2020]
- Jenkins Creator Launches Startup To Speed Software Testing with Machine Learning -- ADTmag - ADT Magazine [Last Updated On: January 30th, 2020] [Originally Added On: January 30th, 2020]
- An Open Source Alternative to AWS SageMaker - Datanami [Last Updated On: January 30th, 2020] [Originally Added On: January 30th, 2020]
- Machine Learning Could Aid Diagnosis of Barrett's Esophagus, Avoid Invasive Testing - Medical Bag [Last Updated On: January 30th, 2020] [Originally Added On: January 30th, 2020]
- OReilly and Formulatedby Unveil the Smart Cities & Mobility Ecosystems Conference - Yahoo Finance [Last Updated On: January 30th, 2020] [Originally Added On: January 30th, 2020]