mapgis2shp

Read and write MapGIS 6.x/67 vector files (.wt, .wl, .wp) with GeoPandas GeoDataFrames.

MapGIS is a widely used closed-source GIS platform in China, especially in geological surveying, engineering, and scientific research. pymapgis provides a lightweight, open-source reader and writer for its native point, line, and polygon vector formats.

Relationship to prior work: This package (mapgis2shp, import name pymapgis) is the matured, validated successor to the first author's earlier pymapgis (2022) single-file reader — both developed by Shijie Li (leecugb). The present version adds coordinate-reference inference, vectorised parsing, polygon-topology reconstruction, and independent validation against the official MapGIS export.

Features

• Read point (.wt), line (.wl), and polygon (.wp) files
• Write GeoDataFrames back to native .wt / .wl / .wp binaries (round-trip lossless)
• Decode GBK-encoded attribute fields and field names
• Decode point graphic parameters (text/symbol kind, subgraph number, glyph size, rotation angle, colour, layer, pen width / fonts)
• Decode line graphic parameters (style and auxiliary style numbers, line/auxiliary colour, width in mm, pattern coefficients, layer, transparent output)
• Decode polygon graphic parameters (fill colour / pattern numbers from the head_9 section)
• Parse the MapGIS 6.x graphic libraries themselves — SubgraphLib for Subgraph.lib point-symbol definitions (including chained records past the index table) and LinestyLib for LINESTY.lib line-style definitions (sublines, element templates, dot/dash rhythm, pen tables)
• Reconstruct polygon topology from arc records — and regenerate it on write (shared boundaries stored as single arcs)
• Preserve or repair invalid polygon geometries with shapely.make_valid
• Export to any format supported by GeoPandas / Fiona (Shapefile, GeoJSON, GeoPackage, etc.)
• Simple command-line interface for quick conversions in both directions

Installation

pip install mapgis2shp

The Python package is imported as pymapgis:

from pymapgis import Reader

Quick start

from pymapgis import Reader

with Reader("example.wp") as r:
    print(r)
    # Write to Shapefile
    r.geodataframe.to_file("example.shp")
    # Or access the GeoDataFrame directly
    print(r.geodataframe.head())

Command-line usage

# Convert a polygon file to Shapefile
pymapgis input.wp output.shp

# Convert to GeoJSON
pymapgis input.wl output.geojson --driver GeoJSON

# Keep raw (possibly invalid) polygon geometries
pymapgis input.wp output.shp --no-make-valid

# Convert a Shapefile (or GeoJSON/GeoPackage) back to MapGIS
pymapgis input.shp output.wp
pymapgis input.geojson output.wl --encoding GBK

# Also decode graphic parameters (style/colour numbers, width, symbol
# number, angle, ...) into extra attribute columns
pymapgis input.wp output.gpkg --graphic-params

# Inspect a MapGIS graphic library (symbol / line-style definitions)
pymapgis lib Subgraph.lib                     # symbol counts (indexed + tail chain)
pymapgis lib Subgraph.lib --symbol 1960       # decode one symbol's geometry
pymapgis lib LINESTY.lib                      # whole-library census
pymapgis lib LINESTY.lib --style 211 --aux 0  # decode one line style

The direction is chosen from the input extension: .wt/.wl/.wp input reads MapGIS; any other input writes MapGIS. The same interface is available as python -m pymapgis input.wp output.shp.

API

Reader(filepath, make_valid=True, read_point_params=False, read_graphic_params=False)

Main entry point for reading a MapGIS file. With read_point_params=True (point files only), the per-point graphic parameter area is decoded as well: the columns point_type (0 = text, 1 = symbol), symbol_no, height, width, spacing and angle (degrees, counter-clockwise from east), plus the shared tail color and layer and the kind-dependent pen_width (symbol points) / font_zh, font_en, font_style (text points), are appended to the GeoDataFrame and exposed separately as point_params. With read_graphic_params=True, graphic parameters are decoded for any file type — point parameters for .wt (as above), line parameters for .wl (linetype, aux_linetype, aux_flag, color, width, x_coef, y_coef, aux_color, layer, transparent, exposed as line_params), and polygon parameters for .wp (fill_color, pattern, pattern_color as a full uint16 from the head_9 section, exposed as polygon_params).

Attributes

Methods

• to_file(filepath, **kwargs) — forward to GeoDataFrame.to_file
• len(reader) — number of features
• str(reader) — summary ("n features (type POINT)"); repr(reader) shows the constructor arguments
• Context manager: with Reader(...) as r: (the file is fully parsed and closed in the constructor)

Constants

• POINT_TYPE_TEXT (0) / POINT_TYPE_SYMBOL (1) — values of the point_type column for .wt graphic parameters
• pymapgis.__version__ — package version string

Exceptions

• MapGISError — base exception
• InvalidFileError — unsupported or unrecognized file
• TopoError — polygon topology reconstruction error
• InvalidDirectoryError — reserved for project/directory errors
• WriterError — a GeoDataFrame cannot be encoded as a MapGIS file

Writer(geodataframe, *, make_valid=True, map_scale=1000.0, snap_tolerance=0.0, graphic_params=True, geometry_type=None)

Encode a GeoDataFrame as a MapGIS binary file. One geometry type per file: Point/MultiPoint for .wt (MultiPoint is exploded with a warning), LineString/MultiLineString for .wl (exploded likewise), and Polygon/MultiPolygon for .wp (a MultiPolygon stays one polygon feature, matching the reader).

from pymapgis import Writer, write

Writer(gdf).to_file("out.wp")   # or the shortcut: write(gdf, "out.wp")

• make_valid — repair invalid polygons before arc decomposition (.wp only)
• map_scale — map-scale denominator for projected CRS (coordinates are stored as value * 1000 / map_scale); ignored for longitude/latitude data
• snap_tolerance — coordinate quantisation step applied before topology construction so that shared boundaries coincide byte-exactly (0 = exact)
• graphic_params — when the frame carries the reader's graphic-parameter columns (point_type/symbol_no/..., linetype/..., fill_color/pattern/pattern_color), write them back into the graphic-parameter areas instead of the attribute table, giving mapgis → shp → mapgis parameter fidelity
• geometry_type — explicit "POINT"/"LINE"/"POLYGON" for empty frames

Writing regenerates polygon topology: adjacent polygons share single arcs, with left/right polygon IDs derived from ring orientation, so the output re-reads losslessly with Reader. Attributes are encoded with MapGIS field types inferred from pandas dtypes (GBK strings, dates, times, numbers); unsupported columns raise WriterError.

Write-side limitations

• .wt label text stored in auxiliary annotation sections is not produced; written .wt files carry geometry, attributes, and symbol points only
• Shapefile's 10-character field-name limit truncates long parameter columns (e.g. pattern_color → pattern_col) when passing through .shp, which disables the matching parameter group on write; GeoJSON/GeoPackage or a direct GeoDataFrame hand-off is unaffected
• Longitude/latitude, Transverse Mercator, Albers, and Lambert CRS are written; other projections raise WriterError
• CGCS2000 has no MapGIS ellipsoid code and is written as WGS84 with a warning (they agree to better than 0.1 mm)

Reading graphic parameters

Beyond geometry and attributes, MapGIS files carry per-feature graphic parameters (how MapGIS draws the feature). Decoding is opt-in:

from pymapgis import Reader, POINT_TYPE_SYMBOL

# Point files: annotation vs. subgraph symbol, symbol number, glyph size,
# rotation angle
with Reader("points.wt", read_graphic_params=True) as r:
    symbols = r.geodataframe[r.geodataframe.point_type == POINT_TYPE_SYMBOL]
    print(symbols[["symbol_no", "height", "width", "angle"]].head())

# Line files: style and auxiliary style numbers, colour index, width in
# millimetres, pattern coefficients
with Reader("lines.wl", read_graphic_params=True) as r:
    print(r.geodataframe[["linetype", "aux_linetype", "color",
                          "width", "x_coef", "y_coef"]].head())

# Polygon files: fill colour / pattern numbers (head_9 section)
with Reader("polygons.wp", read_graphic_params=True) as r:
    print(r.geodataframe[["fill_color", "pattern", "pattern_color"]].head())

Warning — not self-contained. Style, colour, symbol and pattern numbers are indices into the MapGIS system libraries (Slib, line-style library, pattern library) of the originating MapGIS installation; the glyph definitions are not stored in the data files. The same number may mean different things under a different or customised library. Field layouts were reverse-engineered and validated on the layers of map sheet J43C001002 — verify against your own data before relying on them.

Parsing the graphic libraries

The library files referenced by the graphic parameters can be parsed directly (the same parsers back the pymapgis lib subcommand):

from pymapgis import LinestyLib, SubgraphLib, classify_form, compose_feature_style

# Subgraph.lib: point-symbol geometry (mm coordinates, subpaths, fitted circles)
lib = SubgraphLib("Subgraph.lib")
print(lib.n_indexed, "indexed +", lib.n_tail, "tail-chain symbols")
sym = lib.decode(1960)          # None when out of range
for sp in sym.subpaths:
    print(len(sp.points), "points", sp.circle)   # circle = (cx, cy, r) fit

# LINESTY.lib: line styles (1-based, as stored in .wl linetype fields)
styles = LinestyLib("LINESTY.lib")
style = styles.decode(211)
print(classify_form(style))                        # form label + evidence
main, aux = compose_feature_style(styles, 211, 0)  # (style, aux) pair rule

Line-style style numbers and symbol numbers are library-local: they resolve only against the same (or a byte-identical) library that produced the data.

Supported formats

CRS detection supports the most common projections found in MapGIS 6.x files, including longitude/latitude, Gauss-Krüger (Transverse Mercator), Lambert Conformal Conic, and Albers Equal-Area. Because MapGIS stores only projection and ellipsoid index numbers, the complete CRS depends on external MapGIS index files (ellip.dat, etc.).

Technical Documentation: MapGIS Vector File Format

The following section is the technical specification of the MapGIS 6x/67 binary vector format (.wt / .wl / .wp). It is synchronized from docs/MapGIS_Vector_Format.md in this repository.

MapGIS vector files are a closed-source binary vector data format developed by MapGIS (Zhongdi Digital). They are widely used in geological surveying, engineering investigation, and scientific research in China. The format itself does not carry a complete coordinate-system description; projection and ellipsoid parameters must be interpreted using the index tables in the MapGIS installation environment (e.g., mapgis67\program\ellip.dat).

Conventions

• All offsets are 0-based from the beginning of the file.
• int16 / int32 / uint8 / double are all little-endian.
• String fields are encoded as GBK unless otherwise noted.

Overall file structure

The three file types share the same top-level organization:

The index-section start offset is at file bytes 12–15, denoted as data_start. From data_start there are 10 consecutive index records:

head_1 : offset data_start + 0
head_2 : offset data_start + 10
...
head_10: offset data_start + 90

Each index record begins with 8 bytes (start, volume) representing the start offset and size (in bytes) of the corresponding sub-section.

The magic numbers and file IDs are:

Coordinate reference system parsing

The CRS parameters are stored at the same fixed offsets in all three file types:

The projection-type index and ellipsoid index correspond to index tables in the MapGIS installation directory and ellip.dat, respectively. Therefore, the full CRS interpretation depends on the external MapGIS software environment.

Common ellipsoids

Projection parameters

For Gauss-Krüger (projection index 5), Lambert (3), Albers (2), and similar projections, additional parameters are stored as follows. The offsets 175/183/191 correspond to the starting latitude, first standard parallel, and second standard parallel described in the original technical article:

The central meridian and standard parallels are encoded as DDDMMSS.sss BCD-style doubles and must be converted to decimal degrees by splitting degrees, minutes, and seconds:

deg = s[:-4]
min = s[-4:-2]
sec = s[-2:]
decimal_degrees = deg + min/60 + sec/3600

For longitude/latitude (projection type 0), coordinate values are in decimal degrees. For projected coordinate systems, internal coordinates are usually in millimeters; after reading they are converted to meters by scale = scale / 1000.

Point files (.wt)

File header and index section

Index-section meaning:

Coordinate data section

The coordinate data section stores one point per 93 bytes. The first 93-byte record is empty, so the actual point count is:

point_count = coord_volume / 93 - 1

Single point record structure:

Point graphic parameters (bytes 23–92)

Reverse-engineered in September 2026 and validated on the annotation layers of map sheet J43C001002. The byte at offset 31 selects the point kind; the remaining fields are interpreted according to that kind. Sizes are in millimetres and the angle in degrees (counter-clockwise from east, matching the atan2(dy, dx) line-tangent convention — verified by fault symbols whose rotation is parallel (mod 180°) to their parent fault's strike).

These parameters are not self-contained. The subgraph number is an index into the MapGIS system symbol library (Slib) of the originating MapGIS installation; the glyph definitions are not stored in the file. Under a different or customised library the same number may map to a different glyph, and what a rotation of zero means depends on the glyph design. Interpret the values only in the context of the symbol library (and library version) that produced the data.

Line files (.wl)

File header and index section

Index-section meaning:

Line data section

The line data section stores one line index record per 57 bytes. The first 57-byte record is empty, so the actual line count is:

line_count = line_volume / 57 - 1

Single line index structure:

Line graphic parameters (bytes 18–56)

Reverse-engineered in September 2026 and validated on all 18 line layers of map sheet J43C001002 (widths are geologically plausible for every layer, 0.05–4 mm; style numbers cluster by line category).

Line-style and colour numbers reference the external MapGIS line-style library and are not self-contained (same dependency as point parameters).

Additional sections

Beyond the documented sections (lines / coordinates / attributes), .wl files in J43C001002 carry further per-line sections in the header index: head_4 (24 bytes per line), head_7 (32 bytes per line) and head_8 (4 bytes per line). Their content shows no correlation with display parameters and their purpose is undetermined (possibly topology/annotation linkages).

Coordinate data section

The coordinate data section stores anchor points sequentially. Each XY pair occupies 16 bytes (2 × double). Reading uses the anchor point count and coordinate offset from the line index.

Polygon files (.wp)

File header and index section

Index-section meaning:

Arc data section

Polygon files reuse the line arc-storage structure: 57 bytes per arc index record, with the first 57-byte record empty. The fields have the same meaning as in .wl (anchor point count + coordinate offset).

Coordinate data section

Same as line files: each 16 bytes stores one double-precision XY pair. All arc coordinates are stored in this section.

Polygon topology data section

The topology data section stores one record per 24 bytes. The first 24-byte record is empty, so the actual topology record count is:

topo_count = poly_volume / 24 - 1

The first 16 bytes of each record contain 4 little-endian int32 values. The parser mainly uses columns 2 and 3 (0-indexed), i.e., record bytes 8–15:

Polygon IDs are 1-based. To reconstruct a polygon, select all arcs whose left or right polygon ID equals the target ID. If the left ID matches, the arc coordinates are usually reversed so that the polygon boundary is consistently on the same side of the arc. The arcs are then chained by matching endpoints into closed rings, and rings are classified as shells or holes to build Polygon / MultiPolygon geometries.

Polygon graphic-parameter section (head_9)

Reverse-engineered in September 2026 and validated on all 13 polygon layers of map sheet J43C001002: the section holds exactly one record per polygon, and its fields are 100% consistent within each geological unit.

The section stores one record per 40 bytes, the first record is empty, and record i (0-based after the empty record) belongs to polygon ID i + 1:

Colour and pattern numbers reference the external MapGIS colour/pattern libraries and are not self-contained (same dependency as point parameters).

Polygon reconstruction key points

1. Select arcs: For target polygon ID pid, select arcs where left_id == pid or right_id == pid.
2. Orient arcs: If left_id == pid, reverse the arc coordinates so the polygon boundary stays on the consistent side.
3. Form rings: Use a greedy nearest-endpoint merge to chain arcs into closed rings. Endpoint coordinates may differ by ~1e-6 due to floating-point precision.
4. Hole detection: Use point-in-polygon containment between rings to distinguish outer shells and inner holes.
5. Validity repair: Because arc merging can produce self-intersecting rings, shapely.make_valid() or similar repair is recommended after reconstruction.

Attribute data section (common to all file types)

Point, line, and polygon files share the same attribute table structure.

Attribute table header

The original technical article states that field descriptors start at "the 349th byte"; this is a 1-based description. This document uses 0-based offsets, so the start is 348.

Field descriptor

Each field descriptor is fixed 39 bytes:

Field type mapping:

Record data

Immediately after the field descriptors there are record_count × record_length bytes of data. The first record is empty; the actual valid record count is record_count - 1.

Each record is sliced according to the storage offset in the field descriptors. Field length is calculated as:

• Non-final field: next_offset - current_offset
• Final field: record_length - current_offset

String fields are read up to the first \x00. Date fields are year (int16) + month + day. Time fields are hour + minute + seconds (double, including microseconds).

Known limitations

1. Incomplete coordinate system: The file only stores projection/ellipsoid index numbers. The full CRS depends on external ellip.dat and projection index tables. The current implementation embeds common ellipsoids (Beijing 54, Xi'an 80, WGS84, etc.) and projections (Gauss-Krüger, Albers, Lambert).
2. Polygon topology tolerance: Arc endpoints may have tiny deviations, and some source data may contain topological gaps or self-intersections. Geometry validity repair is recommended after reading.
3. Encoding: Field names and string attribute values use GBK. Illegal bytes are typically truncated at the first invalid byte.
4. Scale: In projected coordinate systems internal coordinates are often in millimeters and are converted to meters by scale / 1000; for longitude/latitude systems scale is usually 1.
5. Graphic parameters are library-dependent: symbol, line-style, colour and pattern numbers reference the MapGIS system libraries (Slib, line-style and pattern libraries) of the originating installation, which are not embedded in the file. They are only meaningful together with those libraries (and their versions); some field assignments are validated candidates rather than certainties (see the per-section notes).

Changelog

Unreleased

• Writer: encode GeoDataFrames back to native MapGIS .wt / .wl / .wp binaries — attribute table (GBK strings, dates, times, typed numerics), graphic parameters (with mapgis → shp → mapgis fidelity when the reader's parameter columns are present), CRS (longitude/latitude, Transverse Mercator, Albers, Lambert), and regenerated polygon topology (shared boundaries stored as single arcs with left/right polygon IDs). New public API: Writer, write(), and WriterError
• CLI converts in both directions based on the input extension (.shp, .geojson, .gpkg, ... → .wt/.wl/.wp); new --encoding option
• New runtime dependency: pyogrio>=0.8 (reading shapefiles is now a runtime feature)
• verify_pymapgis.py --roundtrip: Reader → Writer → Reader regression over all local MapGIS files (not recorded in the baseline)

2.2.1

• Packaging fix: pymapgis.rendering is under active development and is not yet ready for distribution (it is also undocumented and requires matplotlib, which is not a declared dependency). It is now excluded from the wheel and sdist; the published package again focuses on reading/conversion. The module remains in the source repository and will be published as a separate package or extra once it stabilises

2.2.0

• read_graphic_params=True: decode line graphic parameters (.wl: linetype, aux_linetype, width, x_coef, y_coef) and polygon graphic parameters (.wp head_9 section: fill_color, pattern, pattern_color), exposed as line_params / polygon_params and joined into the GeoDataFrame
• Format documentation: line graphic-parameter area (bytes 18–56), polygon head_9 section, additional .wl index sections

2.1.0

• read_point_params=True: decode point graphic parameters (.wt: point_type, symbol_no, height, width, spacing, angle), exposed as point_params and joined into the GeoDataFrame
• New constants POINT_TYPE_TEXT / POINT_TYPE_SYMBOL
• Format documentation: point graphic-parameter area (bytes 23–92)

2.0.x

• Matured reader: CRS inference, vectorised parsing, polygon-topology reconstruction, GBK attribute decoding, CLI

Development

Clone the repository and install in editable mode with dev dependencies:

git clone https://github.com/leecugb/mapgis2shp.git
cd mapgis2shp
pip install -e ".[dev]"

Run the test suite:

pytest

Run the smoke-test regression against all local MapGIS files:

python verify_pymapgis.py

License

This project is licensed under the Apache License 2.0.

Acknowledgments

The original reverse-engineering of the MapGIS binary format was done by the author of the legacy pymapgis.py script. This package refactors and extends that work into an installable, tested library.