Skip to content
View JasonGao1010's full-sized avatar
  • HUST
  • Shanghai

Highlights

  • Pro

Block or report JasonGao1010

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
JasonGao1010/README.md

Jinze Gao

Multimodal 3D/4D world modeling for autonomous driving, with broader relevance to embodied systems

B.Eng. candidate in Automation at Huazhong University of Science and Technology

TinyDroneLab · CXRShift · CalibDecisionAudit

I study how camera video and LiDAR observations can be organized into persistent 3D/4D scene representations for autonomous driving, and how those representations can support future scene prediction. My broader interests include embodied systems and the use of large visual and multimodal models as representation and reasoning tools.

My recent work spans multiview sensor geometry, multimodal 3D perception, causal temporal LiDAR modeling, tiny-object video perception, and autonomous-driving software.

Temporal 3D perception

In a sequence-disjoint fitting-stage comparison across eight designated STU sequences, a causal ten-frame LiDAR model improved macro AP by 3.41 percentage points over a matched current-frame model. This work motivates my current questions around persistent temporal state, cross-frame association, and future scene prediction from multimodal streams.

Per-sequence macro AP gains from causal history over a matched current-frame model

Twenty consecutive frames from a real STU LiDAR sequence

A strictly causal stream from a real STU sequence. Data: STU, Nekrasov et al., CVPR 2025.

Multimodal 3D perception under sensor perturbations

When Does a Model-Mined Stress Set Transfer? A Utility- and Reference-Aware Audit in 3D Detection

Jinze Gao, Jie Ma · manuscript

I studied how stress cases mined from one 3D detector transfer to others using BEVFusion, SparseFusion, and DeepInteraction on nuScenes. The study covers 2,007 keyframes under 12 signed single-axis calibration perturbations and a log-disjoint evaluation on 725 keyframes from nine sequences. Within the evaluated two-source pools, candidate-pool limitation accounted for 87.6–96.3% of mean total regret, separating the target-side utility of source-mined hard cases from the quality of the selector applied afterward.

Stress-set overlap, oracle-relative efficiency, and failure-sharing analysis

Sensor geometry and calibration

I investigated inter-camera calibration for a multi-fisheye vehicle rig using Dongfeng real-vehicle recordings. In a separate controlled four-camera synthetic benchmark with 3% corrupted correspondences, explicit fisheye projection, observability checks, and robust joint SE(3) refinement reduced median reprojection error from 7.469 px to 0.411 px.

CalibDecisionAudit extends this work to retrospective camera–LiDAR calibration-decision evaluation. It combines leakage checks, scene-grouped out-of-fold validation, scene-level uncertainty, and reusable SE(3), visibility, and oriented 3D matching utilities.

Leakage-corrected calibration-decision model evaluation with scene-bootstrap intervals

Tiny-object video perception

TinyDroneLab is an RGB tiny-drone detection and tracking pipeline with resolution-aware routing, overlapping tiled inference, full-frame projection, confidence-aware association, and track-conditioned local recovery.

Tiny-drone comparison in which the adaptive route recovers a target missed by three earlier routes

At frame 3,890 of a low-resolution sequence, the adaptive route localizes the annotated drone while three earlier routes return no target. Selected source-study panels are reproduced with permission.

The public repository isolates the executable perception core and includes a deterministic implementation regression with frame-level outputs for recomputation.

Additional work

  • CXRShift studies cross-source chest X-ray classification across three backbones and three seeds. Adding labeled RSNA training and validation data improved DenseNet121 over the Kermany-only ERM baseline by 12.22 percentage points on a fixed exploratory 442-image RSNA test partition; this is known-source adaptation.

  • At PhiGent Robotics, I validated production C++ modules for hybrid A* parking planning and control. Boundary, exception, and parameterized Parasoft C/C++test cases expanded executable code under test from approximately 5,000 to 25,000 lines and reached near-100% line coverage.

Popular repositories Loading

  1. TinyDroneLab TinyDroneLab Public

    Tiny-object video perception with tiled detection, temporal association, and track-conditioned recovery

    Python

  2. CXRShift CXRShift Public

    Cross-source chest X-ray classification with grouped evaluation and uncertainty analysis

    Python

  3. JasonGao1010 JasonGao1010 Public

    Multimodal 3D/4D scene representation and future prediction for autonomous driving

  4. CalibDecisionAudit CalibDecisionAudit Public

    Camera-LiDAR calibration decision evaluation with leakage checks, scene-grouped validation, and SE(3) utilities

    Python