Understand Reality Capture with LiDAR, laser scanning, photogrammetry, point clouds, AI, Scan to BIM, accuracy, validation, and engineering applications.

Check it out!

Reality Capture in engineering is the set of methods used to digitally record the physical condition of an environment, asset, or infrastructure through technologies such as 3D laser scanning, LiDAR, photogrammetry, imagery, drones, and other sensors. The result may take the form of point clouds, meshes, orthophotos, 3D models, maps, georeferenced images, or integrated datasets that support surveying, design, verification, As-Built, BIM, Digital Twin, and asset management.

The concept is broader than any specific technology. LiDAR measures distances using light pulses; photogrammetry reconstructs geometry from overlapping images; terrestrial laser scanning records millions of points from controlled positions; drones can carry cameras or LiDAR sensors. Reality Capture integrates these sources to transform physical conditions into digital information usable by engineering.

It should also not be confused with Scan to BIM. Scan to BIM is a subsequent process in which captured data — typically point clouds — are interpreted and converted into BIM objects or models. Reality Capture covers acquisition, registration, processing, georeferencing, classification, validation, and data preparation before the data are used in design or modeling.

Artificial intelligence adds another layer. Computer vision and machine learning models can classify points, recognize objects, segment surfaces, detect changes, and support information extraction. Value emerges when automation reduces processing effort without losing accuracy, traceability, or connection to the original survey.

What makes up a Reality Capture process

The process begins before the equipment is selected. The team needs to define what must be captured, what accuracy is required, what product will be delivered, and how the data will be validated.

A survey intended for a preliminary study has different requirements from a contractual As-Built or a fabrication basis.

The most common technologies include:

  • terrestrial laser scanning;
  • airborne or drone-mounted LiDAR;
  • terrestrial photogrammetry;
  • aerial photogrammetry;
  • 360° cameras;
  • GNSS and total station for control;
  • mobile sensors and SLAM;
  • georeferenced images and videos.

Autodesk describes Reality Capture as a workflow that starts from scans or photographs, goes through processing and organization, and results in data prepared for use in CAD and other applications. This definition is useful because it reinforces that capture, processing, and use are distinct stages.

Technical Reality Capture workflow in engineering

Planning

Capture

Registration and Georeferencing

Cleaning and Classification

Validation

Point Cloud or Mesh

BIM, CAD, As-Built, or Analysis

Technical Reality Capture workflow in engineering

The Site Survey remains relevant because digital surveying does not eliminate technical inspection. Capture records geometry and appearance; the engineer still needs to interpret function, condition, interfaces, and circumstances that sensors cannot identify on their own.

LiDAR, laser scanning, and photogrammetry: technical differences

The article LiDAR vs. Photogrammetry goes deeper into the comparison between technologies. Within Reality Capture, selection depends on geometry, environment, accuracy, area, texture, and final product.

LiDAR and laser scanning

LiDAR measures distance through the emission and reception of light. In terrestrial scanners, the sensor records large volumes of points in three-dimensional coordinates.

The result is particularly useful when geometry needs to be captured at high density and when lighting or visual texture are insufficient.

Terrestrial laser scanning is commonly suitable for:

  • technical rooms;
  • industrial plants;
  • existing buildings;
  • facades;
  • shafts;
  • structures;
  • exposed services;
  • complex environments.

The content on 3D Laser Scanning in Engineering details acquisition, accuracy, and applications.

Photogrammetry

Photogrammetry derives three-dimensional geometry from overlapping photographs.

Autodesk defines photogrammetry as the extraction of 3D information from images and highlights its use for topographic maps, meshes, point clouds, and drawings.

It is especially efficient when there is good visual texture, adequate lighting, and the ability to obtain sufficient overlap between images.

Drones

Drones expand coverage and access.

They can carry cameras for photogrammetry or LiDAR sensors. The choice depends on terrain, vegetation, obstacles, accuracy, and operational constraints.

Mobile sensors

SLAM systems can accelerate capture in corridors, buildings, and large indoor areas.

Productivity increases, but accuracy depends on trajectory, environment geometry, and the ability to control drift.

Survey planning: accuracy, coverage, and final product

Reality Capture only produces engineering value when the survey starts from a defined purpose, accuracy, and deliverable. Capture technology should be selected after the requirement, not before.

Site Survey and technical survey

A common mistake is starting with the technology and only then defining the use.

Planning should start from the final product.

If the purpose is to update a BIM model, it is necessary to know which disciplines, elements, and properties will be represented. If the objective is an as-is survey, tolerances and the coordinate system need to be defined. If the use is deformation detection, geometric stability and control need to be much more rigorous.

Accuracy

Accuracy is not a single equipment value.

The result depends on:

  • nominal sensor accuracy;
  • distance to target;
  • angle of incidence;
  • resolution;
  • density;
  • registration between stations;
  • geodetic control;
  • environmental conditions;
  • processing.

The specification should distinguish sensor accuracy, registration accuracy, and final-product accuracy.

Coverage

Hidden or occluded areas can create gaps.

Planning positions and trajectories reduces shadow zones.

Density

More points do not automatically mean a better survey.

Density should be compatible with the smallest element that needs to be recognized or modeled.

Coordinate system

Projects combining different disciplines need a common reference.

Coordinate errors can render an otherwise technically accurate point cloud unusable.

When existing conditions form the basis for design, the Engineering As-Is Survey helps structure scope, records, and validation.

Registration, georeferencing, and quality control

Individual captures need to be transformed into a coherent dataset.

Registration

Registration aligns different scans.

It may use targets, common points, geometry, or automatic algorithms.

The result needs to be verified through residuals and control points.

Georeferencing

When the survey needs to interface with topography, GIS, or other datasets, the point cloud should be associated with the appropriate coordinate system.

Control

Independent points help verify the final product.

A good practice is to separate points used for adjustment from those used for validation.

Cleaning

Noise, moving people, reflections, and temporary elements can contaminate the data.

Cleaning should preserve relevant evidence.

Documentation

The survey report should record equipment, configuration, dates, conditions, coordinates, registration method, accuracy, and limitations.

This information makes the dataset auditable.

Where artificial intelligence fits into Reality Capture

The Artificial Intelligence in Engineering pillar treats computer vision and machine learning as interpretation technologies. In Reality Capture, they act mainly after acquisition.

Point cloud classification

Models can separate terrain, vegetation, buildings, piping, structures, or other classes.

Classification reduces manual work but should be measured by class.

Object detection

Computer vision can identify equipment, signs, components, or defects in images.

Segmentation

Surfaces and volumes can be grouped to support modeling.

Assisted registration

Algorithms can help find correspondences between scans or images.

Change detection

Comparing captures from different dates makes it possible to identify displacement, demolition, construction progress, or condition changes.

Information extraction

AI can support measurement, inventory, and preparation of properties.

The output needs to remain linked to the original evidence. Automatic classification should never erase the raw data.

AI layers over Reality Capture data

Physical Capture

Point Cloud, Image, or Mesh

Classification

Detection

Segmentation

Structured Information

Engineering Validation

AI layers over Reality Capture data

When classification or detection is used in technical decisions, metrics such as precision and recall should be evaluated for the relevant classes, not only as a global average.

From point cloud to BIM, CAD, and As-Built

A point cloud is geometric evidence, not a semantic model. When the result needs to become BIM, CAD, or As-Built, a process of interpretation, modeling, and validation is required.

3D Laser Scanning for Engineering

A Point Cloud in Engineering is a geometric representation, not a semantic model.

It records points in space, possibly with color and intensity. For use in BIM, the geometry needs to be interpreted and transformed into elements.

The Scan to BIM structures this transition.

Manual modeling

The designer uses the point cloud as a modeling reference.

It is more controllable, but requires effort.

Semi-automatic extraction

Software can recognize planes, walls, pipes, or simple geometries.

AI and recognition

Models can support classification and segmentation.

Even with automation, the result needs to be verified against the intended purpose.

As-Built

An As-Built represents the constructed condition.

Reality Capture helps document geometry, but As-Built also requires identification, documentation, interfaces, and validation.

The Digital As-Built Model shows how geometry and data can be organized for delivery.

When the final product needs to be developed as an engineering model or documentation, the service of 3D Laser Scanning for Engineering integrates capture, point cloud, BIM, and As-Built.

How to validate a Reality Capture product

When the survey supports a critical project, verification should compare accuracy, coverage, coordinates, and the derived product against previously defined criteria.

Technical Design Review and Validation — Design Review

Validation needs to be defined before capture.

Completeness

Verify whether the required areas are represented.

Geometric accuracy

Compare independent points or known references.

Registration

Analyze error between stations or blocks.

Georeferencing

Confirm coordinates, datum, and transformation.

Noise

Check artifacts, reflections, and spurious points.

Classification

When AI is used, measure errors by class.

Derived model

Compare BIM or CAD against the point cloud.

Metadata

Confirm origin, date, equipment, and method.

An application of Design Review in Engineering Projects can be useful when the survey informs critical design decisions and needs independent verification.

Acceptance criteria and tolerances

Acceptance criteria should be linked to the intended use.

A survey for visualization does not need the same tolerance as a fabrication basis.

The scope may define:

ProductCriterion
registered point cloudmaximum registration error
georeferenced point clouderror at control points
orthophotoresolution and accuracy
meshcompleteness and geometric error
BIM modeldeviation from the point cloud
AI classificationprecision and recall

Tolerances should be technical and measurable.

Avoid vague phrases such as “high accuracy.”

File management and performance

Reality Capture produces large volumes of data.

The architecture needs to address:

  • storage;
  • versioning;
  • formats;
  • indexing;
  • copies;
  • access;
  • processing;
  • archiving.

Point clouds may be divided by area or discipline.

Derived models should not replace raw data without a retention policy.

In BIM environments, the BIM and Engineering Information Management helps define states, CDE, references, and governance of captured data.

How to procure Reality Capture in engineering

The scope should describe the product and performance, not only the equipment.

Physical scope

Areas, environments, extents, obstacles, and constraints.

Technology

Specify when necessary without unnecessarily constraining the solution.

Product

Point cloud, mesh, orthophoto, model, drawings, or inventory.

Coordinates

System and control points.

Accuracy

Measurable criteria.

Coverage

Minimum areas and treatment of occlusions.

Formats

E57, RCP/RCS, LAS/LAZ, IFC, RVT, or others as required.

Metadata

Equipment, date, method, and parameters.

Validation

Control report and evidence.

Handover

Raw, processed, and derived files.

When Reality Capture forms part of a larger surveying, BIM, and brownfield engineering program, Continuing Engineering Consulting Services can organize waves of capture, modeling, and validation.

How to conduct a Reality Capture + AI pilot

A pilot should use a representative area.

  1. define the product;
  2. establish accuracy;
  3. capture;
  4. process;
  5. apply classification or detection;
  6. compare against ground truth;
  7. measure time and error;
  8. validate integration with BIM or CAD;
  9. decide whether to scale.

The pilot needs to evaluate productivity and quality.

Automation that reduces time but increases classification error may not generate a real benefit.

When different suppliers perform capture, modeling, and integration, Owner’s Engineering can maintain acceptance criteria and interfaces from the owner’s perspective.

Quality, temporality, and governance of captured data

Reality Capture produces a spatial snapshot of a moment in time. This characteristic needs to be recognized when the data are used for design, inspection, or operations. A point cloud captured today does not automatically represent tomorrow’s condition; in brownfield environments, construction changes, maintenance, and interferences can make the survey outdated in a short time.

Reference date and validity

Each dataset should record the capture date and time window. When multiple campaigns are combined, the team needs to know whether the data represent the same physical condition. Mixing scans from different times without control can create a digital geometry that never existed simultaneously.

Change detection

Repeated captures make it possible to compare states. Differences may indicate construction progress, removals, deformation, new interferences, or layout changes. Comparison may be geometric, based on distances between point clouds, or semantic when objects are already classified.

AI can support segmentation and detection, but the change threshold needs to be consistent with survey accuracy. A difference smaller than process uncertainty should not be treated as a real physical change.

Occlusions and gaps

Every method has line-of-sight limitations. Pipes may hide other pipes; furniture may block walls; vegetation may conceal terrain. Coverage analysis should identify areas without sufficient evidence rather than automatically filling them through interpolation.

When the final product requires completeness, the solution may combine additional scanner positions, complementary photogrammetry, manual inspection, or existing design data. The choice depends on the risk of assuming unobserved geometry.

Precision, resolution, and accuracy are not synonyms

Resolution describes the level of detail that the sensor can record; precision relates to repeatability or dispersion of measurements; accuracy indicates proximity to the true value or control reference. A dataset may be very dense and still contain a systematic positional error.

Therefore, specifying only a “high-resolution point cloud” does not define geometric quality. The criterion should be linked to the intended use: clash identification, architectural modeling, fabrication, deformation monitoring, or another objective.

Sensor fusion

In complex environments, a single technology may not meet coverage, texture, and accuracy requirements simultaneously. Combining laser scanning, photogrammetry, GNSS, total station, and 360° imagery makes it possible to use the strengths of each source.

Fusion requires a common reference. Coordinates, date, orientation, and metadata need to be compatible so that integration does not create inconsistencies greater than those present in the original datasets.

Integration across campaigns and suppliers

Large programs may involve different capture teams. To maintain interoperability, it is necessary to standardize coordinate systems, conventions, resolution, formats, naming, metadata, and QA/QC criteria.

Without this standardization, each survey may be technically acceptable in isolation and still be difficult to integrate into the consolidated model.

Technology selection matrix

Technology selection should consider accuracy, range, speed, texture, accessibility, and environment simultaneously. Over a large outdoor area, aerial photogrammetry may offer high productivity; in a dense technical room, terrestrial laser scanning tends to provide more controlled geometry; in vegetation, LiDAR may provide information that imagery does not capture with the same consistency.

Hybrid projects are common because no sensor dominates every criterion. The decision should be documented according to purpose rather than equipment preference.

Units, datum, and transformations

Integrations frequently fail because of differences in units, origin, or reference systems. Meters and millimeters, local and geographic coordinates, orthometric and ellipsoidal elevation, or transformations between systems can produce offsets far greater than the sensor’s nominal accuracy.

Therefore, Reality Capture handover should state units, datum, projection, local origin, control points, and any transformation applied. This information is as important as the point cloud file.

Final considerations

Reality Capture is the bridge between physical conditions and the digital environment.

LiDAR, laser scanning, photogrammetry, and drones are acquisition methods. Point clouds, meshes, and orthophotos are intermediate products. BIM, CAD, As-Built, Digital Twin, and asset management are downstream uses.

Artificial intelligence increases the ability to interpret and structure these data, but it does not replace survey planning, geometric control, or validation.

The technically defensible sequence is purpose → planning → capture → registration → control → processing → AI where applicable → validation → project integration.

Brownfield programs often require multiple waves of capture, modeling, and updating. Continuity helps maintain consistent criteria, formats, coordinates, and governance across campaigns.

Continuing Engineering Consulting Services

Technical references

[1] AUTODESK. What is Reality Capture? Autodesk. Available at: https://www.autodesk.com/solutions/reality-capture

[2] AUTODESK. About the Reality Capture Process. Autodesk Help. Available at: https://help.autodesk.com/cloudhelp/ENU/Reality-Capture/files/Getting_Started/about_reality_capture.html

[3] AUTODESK. Photogrammetry Software: Photos to 3D Scans. Autodesk. Available at: https://www.autodesk.com/solutions/photogrammetry-software

[4] INTERNATIONAL ORGANIZATION FOR STANDARDIZATION. ISO 19650 series — Organization and digitization of information about buildings and civil engineering works, including building information modelling (BIM). Geneva: ISO. Available at: https://www.iso.org/standard/68078.html

Frequently asked questions
What is Reality Capture in engineering?

It is the process of digitally recording the physical condition of environments, assets, or infrastructure through laser scanning, LiDAR, photogrammetry, drones, imagery, and other sensors, generating data usable in design, BIM, and As-Built.

Are Reality Capture and Scan to BIM the same thing?

No. Reality Capture covers acquisition and processing of physical conditions. Scan to BIM is a later stage that transforms point clouds and other data into BIM models.

What is the difference between LiDAR and photogrammetry?

LiDAR measures distances using light pulses and generates three-dimensional points. Photogrammetry reconstructs geometry from overlapping photographs. The choice depends on accuracy, texture, lighting, area, and application.

Can AI classify point clouds?

Yes. Machine learning can classify points, segment surfaces, and recognize objects. The result needs to be validated by class and remain linked to the original data.

Can drones perform Reality Capture?

Yes. Drones can carry cameras for photogrammetry or LiDAR sensors, expanding coverage and access in large or difficult areas.

How should survey accuracy be defined?

Accuracy should be defined according to the final product and use, considering sensor, registration, georeferencing, control points, distance, environment, and processing.

Does Reality Capture replace an as-is engineering survey?

Not necessarily. It expands the ability to record geometry, but identification of systems, function, condition, and technical circumstances may still require inspection and engineering surveying.

What should be included in a Reality Capture procurement scope?

Physical scope, final product, coordinate system, accuracy, coverage, formats, metadata, validation, raw files, and handover criteria.

Additional technical materials

Related services

Core content on this topic

Related technical content