0% found this document useful (0 votes)
32 views107 pages

Data Assessment

The document outlines the status and requirements for migrating various data tables to a Bronze level in a data processing pipeline, detailing primary keys, watermark columns, and error tracking. It includes specific tables and their relationships, as well as comments on data flattening and structuring for improved analysis. Additionally, it lists various data sources and their respective owners, along with migration deadlines.

Uploaded by

jdi_sunil
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as XLSX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
32 views107 pages

Data Assessment

The document outlines the status and requirements for migrating various data tables to a Bronze level in a data processing pipeline, detailing primary keys, watermark columns, and error tracking. It includes specific tables and their relationships, as well as comments on data flattening and structuring for improved analysis. Additionally, it lists various data sources and their respective owners, along with migration deadlines.

Uploaded by

jdi_sunil
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as XLSX, PDF, TXT or read online on Scribd
You are on page 1/ 107

Primary Key based on Watermark Column based

End Points WW analysis on WinWire analysis


MEETINGS LIST no primary key no watermark column
PROJECT PERMISSION MANIFEST LIST no primary key created_at,updated_at

loaded to Gold
Errors
In progress
Total

ADLS PATH https://portal.azure.com/#view/Microsoft_Azure_Storage/ContainerMenuBlade


Status Is it required to Migrate to Bronze?
In Progress Yes
In Progress Yes

10
8
2
20

Azure_Storage/ContainerMenuBlade/~/overview/storageAccountId/%2Fsubscriptions%2F34096212-9213-4f72-b8cb-967fdce09a76%2Fre
WinWire Comments
able to parse schema-> prc_meetings_list
able to parse schema-> prc_project_permission_manifest_list

AccountId/%2Fsubscriptions%2F34096212-9213-4f72-b8cb-967fdce09a76%2FresourceGroups%2Frg-mdap-dev%2Fproviders%2FMicrosoft
Error category Metadata created delta tables created bronze loaded
Y Y
Y Y

mdap-dev%2Fproviders%2FMicrosoft.Storage%2FstorageAccounts%2Fdlsmdapdev/path/fsmdapdev/etag/%220x8DB6C0E7D26261E%22/
silver and gold loaded Sprint # Is Full Load Done? Is Incremental Load Done?
6 No No
6 No No

mdapdev/etag/%220x8DB6C0E7D26261E%22/defaultEncryptionScope/%24account-encryption-key/denyEncryptionScopeOverride~/false
Is WW Validation Done? Is WT Validation Done?
YTS YTS
YTS YTS

tion-key/denyEncryptionScopeOverride~/false/defaultId//publicAccessVal/None
Table_Name Column_Name
MEETINGS meetings
PROJECT_PERMISSION_MANIFEST_LIST tools
RFIS questions
SUBMITTALS approvers
DOCUMENTS created_by
RFIS assignees
RFIs created_by
RFIS rfi_manager
RFIS responsible_contractor
SUBMITTALS submittal_package
USERS vendor
SUBMITTALS ball_in_court
USERS address
Connected Dataset (Toric) Relationship Key

Tools [List] id

Users [List] id
Users [List] id
Users [List] id
Users [List] id
Users [List] id
Vendors [List] id
Users [List] id
Vendors [List] id
Users [List] id
Notes
would likely need to broken into a child table

questions contain a question id, no relation to a user or contact


approvers_user_id in submittals
documents.created_by_id = users.id
rfis.assignees_id = users.id
rfis.created_by_id = users.id
rfis.rfi_manager_id = users.id
rfis.responsible_contractor_id = vendors.id
submittals.submittals_package_created_by_id = users.id
users.vendor_id = vendors.id
submittals.ball_in_court_id = users.id
combine values in array to create one address
Table_Name Column_Name Depth Array/Contains Array(Y/N)

DOCUMENTS file 3N

DOCUMENTS created_by 2Y

MEETINGS meetings 3Y
PROJECT_PERMISSION_MANIFEST_LIST tools 3Y

RFIS questions 3Y

RFIS assignees 2Y
DRAWINGS current_revision 2N
OBSERVATIONS origin 2N
OBSERVATIONS assignee 2N

RFIS responsible_contractor 2Y

SUBMITTALS approvers 3Y

SUBMITTALS submittal_package 2Y

SUBMITTALS ball_in_court 1Y

DOCUMENTS children 1N
DRAWINGS thumbnail_url 1N
DRAWINGS large_thumbnail_url 1N
FORMS thumbnail_url 1N
FORMS created_by 1N
FORMS attachment 1N
FORMS fillable_pdf 1N
INCIDENTS created_by 1N
OBSERVATIONS created_by 1N
OBSERVATIONS type 1N
OBSERVATIONS location 1N
PHOTOS uploader 1N
PHOTOS links 1N
RFIS cost_impact 1N
RFIS priority 1N
RFIS rfi_manager 1N
RFIS schedule_impact 1N

RFIS assignee 1N
RFIS created_by 1N

USERS vendor 2Y
SUBMITTALS created_by 1N
SUBMITTALS recieved_from 1N
SUBMITTALS specification_section 1N
SUBMITTALS submittal_manager 1N
SUBMITTALS type 1N
SUBMITTALS responsible_contractor 1N
SUBMITTALS status 1N

USERS address 1Y
VENDOR logo 1N

VENDOR project_ids 1Y
Comments WW Comments
Doesn't contain arrays, a flattening procedure
could be implemented. Considering exclusion of
this type.

Its array inside a struct, we need to


Some contain the 'company_name' array, which standardize this. Pls confirm
usually only contains one company. Some entries Mel - Confirmed company name array
are null. can be excluded out for now.
Mel - Confirmed to exclude meetings
Keep only meeting ID and created_by ID. array column
Simply store the ID of the tool.
Create a questions table, errors field not
populated in any instance, might just need to be
flattened.

Create an assignees table, no flattening required.


Analyze if assignees pertains to the users table.
Flatten
Flatten
Flatten
Contains the array 'name', which only has 1
instance of a name in every field.
Approvers field can be composed into a table,
with the contained structures needing a simple
flatten.
Contains the submittal_ids array, which could just
be componsed into a simple list.
May need a separate table, with the interior
structures flattened,
Looks Fine, Flattening and bring it to root
Flatten level
Flatten
Flatten
Flatten
Just keep ID field only.
Flatten
Flatten
Flatten
Flatten
Flatten
Flatten
Flatten, might be associated with a USER.
Flatten
Flatten
Flatten
Flatten, might be associated with a USER.
Flatten
Flatten, might be associated with a company or
another table not present in the pipeline
Flatten
Contains the 'name' array, which utilizes 1 ID
from the 'id' column.
Flatten
Flatten
Flatten
Flatten
Flatten
Flatten
Flatten
Can just be converted into a string list or
something of that nature, no additional data
contained.
Flatten
Just a simple list, doesn't necessarily pertain to
another existing table.
Scenario Example Table Example Object
Single layer object, no arrays DOCUMENTS children
Multiple layer object, no arrays DOCUMENTS file
Single layer array object USERS address
Array containing multiple objects PROJECT_PERMISSION_MANIFEST_LIST tools
Object containing array(s) SUBMITTALS submittal_package
Potential Solutions
Endpoint Name Table Name Column Name
Data Type Notes
Datasource Owner Table Date
CMiC Base Oracle DA. CLASSIFIER_LOV_VALUES_TN 2/13/2024
CMiC Base Oracle DA. DEPT_TABLE_TN 2/13/2024
CMiC Base Oracle DA. IMG_TRACKING_INFORMATION_TN 2/13/2024
CMiC Base Oracle DA. INSTYPE_TN 2/13/2024
CMiC Base Oracle DA. JCDETAIL_TN 2/13/2024
CMiC Base Oracle DA. JCFCTPRFPROJ_TN 2/13/2024
CMiC Base Oracle DA. JCJOB_TABLE_TN 2/13/2024
CMiC Base Oracle DA. MP_SECROLE_TN 2/13/2024
CMiC Base Oracle DA. MP_USERROLESEC_TN 2/13/2024
CMiC Base Oracle DA. OMBUILDINGTYPE_TN 2/13/2024
CMiC Base Oracle DA. OMCLASSIFIERVAL_TN 2/13/2024
CMiC Base Oracle DA. PMPROJCONTACT_TN 2/13/2024
CMiC Base Oracle DA. PMPROJCONTACTROLE_TN 2/13/2024
CMiC Base Oracle DA. PMPROJECT_TABLE_TN 2/13/2024
CMiC Base Oracle DA. PMPROJPARTNER_TN 2/13/2024
CMiC Base Oracle DA. PMROLE_TN 2/13/2024
CMiC Base Oracle DA. PMSUBMITTALTYPE_TN 2/13/2024
CMiC Base Oracle DA. PORTALSEC_TN 2/13/2024
CMiC Base Oracle DA. PYCOMPAYPRD_TN 2/13/2024
CMiC Base Oracle DA. PYEMPLOYEE_TABLE_TN 2/13/2024
CMiC Base Oracle DA. PYTRADES_TN 2/13/2024
CMiC Base Oracle DA. SEC_TN 2/13/2024
CMiC Base Oracle DA. SYSCONTACT_TN 2/13/2024
CMiC Base Oracle DA. TARGETROLES_TN 2/13/2024
CMiC Base Oracle DA. UE_VALID_FIELD_DATA_TN 2/13/2024
CMiC Base Oracle DA. VOUCHER_TN 2/13/2024
CMiC Base Oracle DA. APREGINV_TN 2/27/2024
CMiC Base Oracle DA. BPARTNERS_TABLE_TN 2/27/2024
CMiC Base Oracle DA. BPCLASSIFICATION_TN 2/27/2024
CMiC Base Oracle DA. BPVENDORS_TN 2/27/2024
CMiC Base Oracle DA. COMPANY_TN 2/27/2024
CMiC Base Oracle DA. DMISSUEPRIORITY_TN 2/27/2024
CMiC Base Oracle DA. DMISSUESTATUS_TN 2/27/2024
CMiC Base Oracle DA. EMACTUALLOCATION_TN 2/27/2024
CMiC Base Oracle DA. EMEQPCLASS_TN 2/27/2024
CMiC Base Oracle DA. EMEQUIPMENT_TABLE_TN 2/27/2024
CMiC Base Oracle DA. EMHOMELOCATION_TN 2/27/2024
CMiC Base Oracle DA. IMG_DOCUMENTS_TABLE_TN 2/27/2024
CMiC Base Oracle DA. OMOPPORTUNITY_TN 2/20/2024
CMiC Base Oracle DA. PMCHECKLISTDETAIL_TN 2/20/2024
CMiC Base Oracle DA. PMCHECKLISTTYPE_TN 2/20/2024
CMiC Base Oracle DA. PMDISTRIBUTION_TN 2/27/2024
CMiC Base Oracle DA. PYEMPPAYHIST_TN 2/20/2024
CMiC Base Oracle DA. SDOBJUSREXTVALUE_TN 2/20/2024
CMiC Base Oracle DA. SYSACTIONITEMS_TN 2/27/2024
CMiC Base Oracle DA. SYSCONTACT_REFERENCE_TN 2/27/2024
CMiC Base Oracle DA. UE_FIELD_PROMPTS_TN 2/20/2024
CMiC Base Oracle DA. UE_FIELDS_TN 2/20/2024
CMiC Base Oracle DA. WT_OMCLASSIFIER_GROUPS_TN 2/20/2024
CMiC Base Oracle DA. JCJOBSECGRPUSER_TN 3/14/2024
CMiC Base Oracle DA. omclassifier_tn 3/14/2024
CMiC Base Oracle DA. pyworkloc_tn 3/14/2024
CMiC Base Oracle DA. INVOICE_TN 3/21/2024
CMiC Base Oracle DA. JCJOBSECGRPJOB_TN 3/21/2024
CMiC Base Oracle DA. OMCONTRACTTYPE_TN 3/21/2024
CMiC Base Oracle DA. OMOPP_UDF_TN 3/21/2024
CMiC Base Oracle DA. OMOPPORTUNITY_SUB_TN 3/21/2024
CMiC Base Oracle DA. SDPICKRULE_TN 3/21/2024
CMiC Base Oracle DA. VOUDIST_TN 3/21/2024
Azure SQL Target Zero app_case_incident 3/14/2024
Azure SQL Target Zero app_case_observation 3/14/2024
Azure SQL Target Zero app_case_recognition 3/14/2024
Azure SQL Target Zero app_case_sf_code 3/14/2024
Azure SQL Target Zero app_case 3/14/2024
Azure SQL Target Zero app_case_violation 3/14/2024
Azure SQL Target Zero Area 3/14/2024
Azure SQL Target Zero BODY_PART 3/14/2024
Azure SQL Target Zero Building 3/14/2024
Azure SQL Target Zero causation_factor 3/14/2024
Azure SQL Target Zero CMIC_EMP 3/14/2024
Azure SQL Target Zero contractor 3/14/2024
Azure SQL Target Zero Floor 3/14/2024
Azure SQL Target Zero injury_type 3/14/2024
Azure SQL Target Zero jobsite 3/14/2024
Azure SQL Target Zero login_tracker 3/14/2024
Azure SQL Target Zero report_topic 3/14/2024
Azure SQL Target Zero role 3/14/2024
Azure SQL Target Zero sub_jobsite 3/14/2024
Azure SQL Target Zero Trade 3/14/2024
Azure SQL Target Zero user_jobsite 3/14/2024
Azure SQL Target Zero user 3/14/2024
SharePoint Excel N/A N/A N/A
SharePoint Excel N/A N/A N/A
SharePoint Excel N/A N/A N/A
SharePoint Excel N/A N/A N/A
SharePoint Excel N/A N/A N/A
SharePoint Excel N/A N/A N/A
SharePoint Excel N/A N/A N/A
SharePoint List N/A N/A N/A
SharePoint List N/A N/A N/A
SharePoint List N/A N/A N/A
SharePoint List N/A N/A N/A
SharePoint List N/A N/A N/A
SharePoint List N/A N/A N/A
SharePoint List N/A N/A N/A
SharePoint List N/A N/A N/A
SharePoint List N/A N/A N/A
SharePoint List N/A N/A N/A
SharePoint List N/A N/A N/A
SharePoint List N/A N/A N/A
SharePoint List N/A N/A N/A
SharePoint List N/A N/A N/A
Procore N/A prc_admin_equipment_list N/A
Procore N/A prc_checklist_inspection_schedules_list N/A
Procore N/A prc_checklist_inspections_sections_list N/A
Procore N/A prc_checklist_sections N/A
Procore N/A prc_checklist_sections_list N/A
Procore N/A prc_construction_report_logs N/A
Procore N/A prc_forms N/A
Procore N/A prc_incidents N/A
Procore N/A prc_observations N/A
Procore N/A prc_rfis N/A
Procore N/A prc_meetings N/A
Procore N/A prc_project_permission_manifest_list N/A

Procore N/A prc_documents N/A

Procore N/A prc_drawings N/A


Procore N/A prc_equipment N/A
Procore N/A prc_images_list N/A
Procore N/A prc_photos N/A

Procore N/A prc_specification_sets N/A

Procore N/A prc_submittals N/A

Procore N/A prc_tasks N/A


Azure SQL Target Zero prc_users 6/11/2024
Azure SQL Target Zero SGH 6/11/2024
CMiC Base Oracle DA. ABALTYPE_TN 6/11/2024
CMiC Base Oracle DA. ACCOUNT_TN 6/11/2024
CMiC Base Oracle DA. ACCTYPE_TN 6/11/2024
CMiC Base Oracle DA. BACURRENCY_TN 6/11/2024
CMiC Base Oracle DA. BPCUSTOMERS_TN 6/11/2024
CMiC Base Oracle DA. CHEQUE_TN 6/11/2024
CMiC Base Oracle DA. CMDETAIL_ORIGB_POSTED_TN 6/11/2024
CMiC Base Oracle DA. CMDETAIL_POSTED_TN 6/11/2024
CMiC Base Oracle DA. CMDETAIL_TN 6/11/2024
CMiC Base Oracle DA. CMDETVENDATA_ORIGB_POSTED_TN 6/11/2024
CMiC Base Oracle DA. CMDETVENDATA_POSTED_TN 6/11/2024
CMiC Base Oracle DA. CMDETVENDATA_TN 6/11/2024
CMiC Base Oracle DA. CMMAST_ORIGB_POSTED_TN 6/11/2024
CMiC Base Oracle DA. CMMAST_POSTED_TN 6/11/2024
CMiC Base Oracle DA. CMMAST_TN 6/11/2024
CMiC Base Oracle DA. CMOWNCHGNUM_TN 6/11/2024
CMiC Base Oracle DA. CMSTATUS_TN 6/11/2024
CMiC Base Oracle DA. CONSCHART_TN 6/11/2024
CMiC Base Oracle DA. CUSTCLAS_TN 6/11/2024
CMiC Base Oracle DA. EMDETAIL_TN 6/11/2024
CMiC Base Oracle DA. EMLOCHIST_TN 6/11/2024
CMiC Base Oracle DA. EMTRANCODE_TN 6/11/2024
CMiC Base Oracle DA. EMTRANPOST_TN 6/11/2024
CMiC Base Oracle DA. FAASSET_TN 6/11/2024
CMiC Base Oracle DA. GLEDGER_TN 6/11/2024
CMiC Base Oracle DA. GLTAC_TN 6/11/2024
CMiC Base Oracle DA. INS_COMMITMENT_COMPLIANCE_F_TN 6/11/2024
CMiC Base Oracle DA. INSVOU_TN 6/11/2024
CMiC Base Oracle DA. INVPAY_TN 6/11/2024
CMiC Base Oracle DA. JBBILL_TN 6/11/2024
CMiC Base Oracle DA. JBBILLDET_TN 6/11/2024
CMiC Base Oracle DA. JBCONT_TN 6/11/2024
CMiC Base Oracle DA. JBCONTDET_MILESTONE_TN 6/11/2024
CMiC Base Oracle DA. JBCONTDET_TN 6/11/2024
CMiC Base Oracle DA. JBGROUP_TN 6/11/2024
CMiC Base Oracle DA. JCDETAIL_UNPOSTED_SC_RFP_TN 6/11/2024
CMiC Base Oracle DA. JCJOBCAT_TN 6/11/2024
CMiC Base Oracle DA. JCJOBSECGRP_TN 6/11/2024
CMiC Base Oracle DA. JCMPHS_TN 6/11/2024
CMiC Base Oracle DA. OMOPP_STAGE_HIST_TN 6/11/2024
CMiC Base Oracle DA. OMSTAGE_TN 6/11/2024
CMiC Base Oracle DA. PAYMENT_TN 6/11/2024
CMiC Base Oracle DA. PMBIDITEMCOLUMNPROJ_TN 6/11/2024
CMiC Base Oracle DA. PMBIDPRICINGSET_TN 6/11/2024
CMiC Base Oracle DA. PMBIDPRICINGSETDATA_TN 6/11/2024
CMiC Base Oracle DA. PMCHECKLISTHEADER_TN 6/11/2024
CMiC Base Oracle DA. PMCHECKLISTVALUE_TN 6/11/2024
CMiC Base Oracle DA. PMDESCRIPTION_TN 6/11/2024
CMiC Base Oracle DA. PMHISTORY_TN 6/11/2024
CMiC Base Oracle DA. PMJOURNAL_TN 6/11/2024
CMiC Base Oracle DA. PMNOTES_TN 6/11/2024
CMiC Base Oracle DA. PMPROJECTITEM_TN 6/11/2024
CMiC Base Oracle DA. WT_JC_WIP_DAILY 6/11/2024
CMiC Base Oracle DA. PMPROJPARTNROLE_TN 7/31/2024
CMiC Base Oracle DA. PMPROJROLE_TN 6/11/2024
CMiC Base Oracle DA. PMRFI_TN 6/11/2024
CMiC Base Oracle DA. PMSUBMITTAL_TN 6/11/2024
CMiC Base Oracle DA. PYEMPHIST_TN 6/11/2024
CMiC Base Oracle DA. PYEMPTIMSHT_TN 6/11/2024
CMiC Base Oracle DA. SCMAST_TN 6/11/2024
CMiC Base Oracle DA. SCSCHED_TN 6/11/2024
CMiC Base Oracle DA. SDPICKH_TN 6/11/2024
CMiC Base Oracle DA. SDPICKLISTSECURITY_TN 6/11/2024
CMiC Base Oracle DA. SUBLEDGR_TN 6/11/2024
CMiC Base Oracle DA. SYSAIRECUR_TN 6/11/2024
CMiC Base Oracle DA. SYSOBJAUDIT_TN 6/11/2024
CMiC Base Oracle DA. UETD_FLY_PIR 6/11/2024
CMiC Base Oracle DA. UETD_GLDEPTSEC 6/11/2024
CMiC Base Oracle DA. VOUCHQ_TN 6/11/2024
CMiC Base Oracle DA. WGTCONV_TABLE_TN 6/11/2024
CMiC Base Oracle DA. WGTMES_TABLE_TN 6/11/2024
CMiC Base Oracle DA. WT_EDW_SEC_MATRIX 6/11/2024
CMiC Base Oracle DA. WT_JC_WIP_DAILY_T 6/11/2024
CMiC Base Oracle DA. WT_OM_OFFICE_DATASHEET 6/11/2024
CMiC Base Oracle DA. WT_OM_OFFSITE_DATASHEET 6/11/2024
CMiC Base Oracle DA. WT_OM_PROJ_DEMOB_HIST 6/11/2024
CMiC Base Oracle DA. WT_PY_OVERHEAD_DASHBOARD 6/11/2024

CMiC Base Oracle JSJ75 WT_REGION_MAPPING 6/11/2024


CMiC Base Oracle DA. JIRESOURCE 6/17/2024
CMiC Base Oracle DA. jccat_tn 6/17/2024
CMiC Base Oracle DA. faascat_tn 6/17/2024
CMiC Base Oracle DA. hrorganizations_tn 6/17/2024
CMiC Base Oracle DA. hrempmems_tn 6/17/2024
CMiC Base Oracle DA. hrmemtypes_tn 6/17/2024
CMiC Base Oracle DA. syscontact_move_hist_tn 6/18/2024
CMiC Base Oracle DA. jcjobhphs_table_tn 6/20/2024
CMiC Base Oracle DA. omclassifiertype_tn 6/20/2024
CMiC Base Oracle DA. omoppocompetitor_tn 6/20/2024
CMiC Base Oracle DA. omcompetitor_tn 6/20/2024
CMiC Base Oracle DA. omoppomarketsector_tn 6/20/2024
CMiC Base Oracle DA. sd_object_audit_tn 6/20/2024
CMiC Base Oracle DA. jcbal_tn 6/20/2024
CMiC Base Oracle DA. jccontforecast_tn 6/20/2024
CMiC Base Oracle DA. jccontforecastdet_tn 6/20/2024
CMiC Base Oracle DA. insdetail_tn 6/20/2024
CMiC Base Oracle DA. PYEMPSECGRPUSER_TN 6/20/2024
CMiC Base Oracle DA. PYEMPSECGRP_TN 6/20/2024
CMiC Base Oracle DA. roles_tn 6/20/2024
CMiC Base Oracle DA. sdprivilege_tn 6/20/2024
CMiC Base Oracle DA. FORMROLES_TN 6/20/2024
CMiC Base Oracle DA. INSGRPUSER_TN 6/20/2024
CMiC Base Oracle DA. INSGROUP_TN 6/20/2024
CMiC Base Oracle DA. userroles_tn 6/20/2024
CMiC Base Oracle DA. sd_menu_config_tn 6/20/2024
CMiC Base Oracle DA. emcomponent_tn 6/20/2024
CMiC Base Oracle DA. sdobjusrextdef_tn 6/20/2024
CMiC Base Oracle UIG wt_rdofo_mapping 6/20/2024
CMiC Base Oracle DA. uigtargetoption_cu$ 6/20/2024
CMiC Base Oracle DA. WT_ES_RECRUITING_DATA 7/29/2024
CMiC Base Oracle DA. wt_jc_wip_daily Melanie
CMiC Base Oracle DA. wt_mapping_matrix_new Melanie
CMiC Base Oracle DA. wt_gl_org_chart Melanie
CMiC Base Oracle DA. wt_pm#key_players Melanie
CMiC Base Oracle DA. da.paytype_tn 8/19/2024
Count Primary key
Err:504 cls_trace_id , CLS_CODE, CLS_VALUE
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 PORSEC_USER
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 Full Load
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 N/A
Err:504 OMCG_OMC_ORASEQ
205030 N/A
1222 N/A
5161 N/A
128553 N/A
80563 N/A
6 N/A
37046 N/A
4312 N/A
897 N/A
9569629 N/A
8894 N/A
86838 N/A
72162 N/A
1714 N/A
227769 N/A
59815 N/A
10585 N/A
22 N/A
4239 N/A
5 N/A
5193 N/A
121774 N/A
10400 N/A
79 N/A
1743 N/A
286626 N/A
12 N/A
17 N/A
419 N/A
51 N/A
47578 N/A
531349 N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A id
N/A id
N/A id
N/A id
N/A id
N/A id
N/A id
N/A id
N/A id
N/A id
N/A no primary key
N/A no primary key

N/A id

N/A id
N/A id
N/A
N/A id

N/A id

N/A id

N/A id
23 N/A
2
1252 Full Load
9
1
2684
1696555
190056
3360839
384638
274
872800
139095
21484
830015
135646
77855
174
1
0
1056508
85246
1001
849457
7351
15878636
0
188909
3664119 ICCF_ORASEQ
136743
113560
17341724
15836
19950
1208500
3634501
3216
1652432
7482
554799
93719
15
99999
1264
263274
172731
677390
18215629
1406619
2191705
1408847
15213810
545960
324256
1500 Full Load
1510
325158
467122
126288
11336356
598878
1605598
885
314
8
39
81335920
2550 Full Load
416
2724960
1444
38
194
2179 Full Load
31615 Full Load
31622 Full Load
33 Full Load
47058 Full Load
51 Full Load

22240 STATE_CODE
393 ID
38
887
4442
9
234896
3077421
54
3688
609
7634
34148599
31088621
28987015
28977702
780640
15240
3
60
210
14130
7989
3
15784
5
6
21
222
612 Full Load
2188
3805 Full Load (primary key is: e_emp_no)
Views
Views
Views
Views
7 Full Load (primary key is: PAYTYP_CODE)
Path
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
AP Rejects Tracking.xlsx
Jeff Numbers - Q3 2022.xls
Monthly Paydex.xlsx
https://whitingturner.sharepoint.com/:x:/r/sites/CMiCTeam2/Shared%20Documents/Analytics/Sharepoint%20ETL%20Files/C
https://whitingturner.sharepoint.com/:x:/r/sites/CMiCTeam2/Shared%20Documents/Analytics/Sharepoint%20ETL%20Files/C
https://whitingturner.sharepoint.com/:x:/r/sites/CMiCTeam2/Shared%20Documents/Analytics/Sharepoint%20ETL%20Files/C
https://whitingturner.sharepoint.com/:x:/r/sites/CMiCTeam2/Shared%20Documents/Analytics/Sharepoint%20ETL%20Files/R
Info Sys & Analytics - CR Solutions - WT Submissions - All Items (sharepoint.com)
https://whitingturner.sharepoint.com/sites/CMiCTeam2/Lists/EEO%20Liaisons/AllItems.aspx
Info Sys & Analytics - Job Access Audit List - All Items (sharepoint.com)
Info Sys & Analytics - LK-Departments (Active) - All Items (sharepoint.com)
Info Sys & Analytics - LK-WT Offices - All Items (sharepoint.com)
Info Sys & Analytics - New Power App/Flow Request List - My Requests (sharepoint.com)
Info Sys & Analytics - Plangrid App to Flow - All Items (sharepoint.com)
Info Sys & Analytics - Project Data Mapping - All Items (sharepoint.com)
Info Sys & Analytics - SEC-External User Job Security - All Items (sharepoint.com)
Info Sys & Analytics - SEC-Project Analytics Job Security - All Items (sharepoint.com)
Info Sys & Analytics - SEC-RDOFO by WT Office - All Items (sharepoint.com)
Info Sys & Analytics - SEC-Schedule Managers - All Items (sharepoint.com)
Info Sys & Analytics - SEC-SilkRoad College Mapping - All Items (sharepoint.com)
Info Sys & Analytics - SEC-Sr Supt by Department - All Items (sharepoint.com)
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A

N/A

N/A
N/A
N/A
N/A

N/A

N/A

N/A
N/A
File Name / Folder Name EndPoint
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
AP Rejects Tracking.xlsx N/A
Jeff Numbers - Q3 2022.xls N/A
Monthly Paydex.xlsx N/A
CR Solutions cleanup N/A
CR Solutions Daily Data as of 20240215 N/A
CR Solutions Daily Data as of 7-27-23 N/A
Recruiting Needs N/A
CR Solutions - WT Submissions N/A
EEO Liaisons N/A
Job Access Audit Table N/A
LK-Departments (Active) N/A
LK-WT Offices N/A
New Power App/Flow Request List N/A
Plangrid App to Flow N/A
Project Data Mapping N/A
SEC-External User Job Security N/A
SEC-Project Analytics Job Security N/A
SEC-RDOFO by WT Office N/A
SEC-Schedule Managers N/A
SEC-SilkRoad College Mapping N/A
SEC-Sr Supt by Department N/A
ADMIN EQUIPMENT LIST ADMIN EQUIPMENT LIST
CHECKLIST INSPECTION SCHEDULES LIST CHECKLIST INSPECTION SCHEDULES LIST
CHECKLIST INSPECTIONS SECTIONS LIST CHECKLIST INSPECTIONS SECTIONS LIST
CHECKLIST SECTIONS CHECKLIST SECTIONS
CHECKLIST SECTIONS LIST CHECKLIST SECTIONS LIST
CONSTRUCTION REPORT LOGS CONSTRUCTION REPORT LOGS
FORMS LIST FORMS LIST
INCIDENTS INCIDENTS
OBSERVATIONS LIST OBSERVATIONS LIST
RFIS LIST RFIS LIST
MEETINGS LIST MEETINGS LIST
PROJECT PERMISSION MANIFEST LIST PROJECT PERMISSION MANIFEST LIST

DOCUMENTS LIST DOCUMENTS LIST

DRAWINGS LIST DRAWINGS LIST


EQUIPMENT LIST EQUIPMENT LIST
PHOTOS PHOTOS
SPECIFICATION SETS LIST SPECIFICATION SETS LIST

SUBMITTALS LIST SUBMITTALS LIST

TASKS LIST TASKS LIST

USERS LIST USERS LIST


N/A N/A
Sprint # for Full Load Sprint # for Incremental Load Incremental load findings

9 9

9 9

9 9

9 9
9 9

9 9

9 9
9 9

9 9
JSGU__IU__UPDATE_DATE
OMC__IU__UPDATE_DATE
WRL__IU__UPDATE_DATE
INV__IU__UPDATE_DATE
JCGJ__IU__UPDATE_DATE
OMCT__IU__UPDATE_DATE
OPUDF__IU__UPDATE_DATE
OMOPS__IU__UPDATE_DATE
SDPICKR__IU__UPDATE_DATE
9 9 VDIST__IU__UPDATE_USER
2 3 N/A
2 3 correction_date
2 3 correction_date
2 3 UPDATED
2 3 UPDATED
2 3 correction_date
2 3 UPDATED
2 3 UPDATED
3 3 UPDATED
2 3 UPDATED
2 4 REFRESH_DATE
2 3 UPDATED
2 3 UPDATED
2 3 UPDATED
3 3 UPDATED
2 3 TIMESTAMP
2 3 UPDATED
2 3 UPDATED
3 3 UPDATED
2 3 UPDATED
3 3 created_at
3 3 N/A
6 N/A
NA N/A
6 N/A
6 N/A
NA N/A
6 N/A
6 N/A
4 N/A
4 N/A
4 N/A
4 N/A
4 N/A
4 N/A
4 N/A
4 N/A
4 N/A
4 N/A
4 N/A
4 N/A
4 N/A
4 N/A
5 5
5 5
5 5
5 5
5 5
6 6
5 5
5 5
5 5
5 5
6 6
6 6

7 7

7 7
7 7
7 7
7 7

7 7

7 7

7 7
7 7 UPDATED
Watermark Column In Watermark Column is Null then
CLS__IU__UPDATE_DATE CLS__IU__CREATE_DATE
DEPT__IU__UPDATE_DATE DEPT__IU__CREATE_DATE
RESPONSIBLE__IU__UPDATE_DATE RESPONSIBLE__IU__CREATE_DATE
INSTYP__IU__UPDATE_DATE INSTYP__IU__CREATE_DATE
JCDT__IU__UPDATE_DATE JCDT__IU__CREATE_DATE
JFPP__IU__UPDATE_DATE JFPP__IU__CREATE_DATE
JOB__IU__UPDATE_DATE JOB__IU__CREATE_DATE
ROLE__IU__UPDATE_DATE ROLE__IU__CREATE_DATE
UR__IU__UPDATE_DATE UR__IU__CREATE_DATE
OMBT__IU__UPDATE_DATE OMBT__IU__CREATE_DATE
OMCV__IU__UPDATE_DATE OMCV__IU__CREATE_DATE
PMPCR__IU__UPDATE_DATE PMPCR__IU__CREATE_DATE
PMPC__IU__UPDATE_DATE PMPC__IU__CREATE_DATE
PMP__IU__UPDATE_DATE PMP__IU__CREATE_DATE
PMPP__IU__UPDATE_DATE PMPP__IU__CREATE_DATE
PMR__IU__UPDATE_DATE PMR__IU__CREATE_DATE
PMSMT__IU__UPDATE_DATE PMSMT__IU__CREATE_DATE
PORSEC__IU__UPDATE_DATE PORSEC__IU__CREATE_DATE
PPR__IU__UPDATE_DATE PPR__IU__CREATE_DATE
EMP__IU__UPDATE_DATE EMP__IU__CREATE_DATE
TRD__IU__UPDATE_DATE TRD__IU__CREATE_DATE
SEC__IU__UPDATE_DATE SEC__IU__CREATE_DATE
SYSC__IU__UPDATE_DATE SYSC__IU__CREATE_DATE
TRL__IU__UPDATE_DATE TRL__IU__CREATE_DATE
UEVFD__IU__UPDATE_DATE UEVFD__IU__CREATE_DATE
VOU__IU__UPDATE_DATE VOU__IU__CREATE_DATE
APRI__IU__UPDATE_DATE APRI__IU__CREATE_DATE
BP__IU__UPDATE_DATE BP__IU__CREATE_DATE
BPC__IU__UPDATE_DATE BPC__IU__CREATE_DATE
BPVEN__IU__UPDATE_DATE BPVEN__IU__CREATE_DATE
COMP__IU__UPDATE_DATE COMP__IU__CREATE_DATE
DMIP__IU__UPDATE_DATE DMIP__IU__CREATE_DATE
DMEIS__IU__UPDATE_DATE DMIS__IU__CREATE_DATE
EMAL__IU__UPDATE_DATE EMAL__IU__CREATE_DATE
EMEC__IU__UPDATE_DATE EMEC__IU__CREATE_DATE
EME__IU__UPDATE_DATE EME__IU__CREATE_DATE
EMHL__IU__UPDATE_DATE EMHL__IU__CREATE_DATE
IMGD__IU__UPDATE_DATE IMGD__IU__CREATE_DATE
OMOP__IU__UPDATE_DATE OMOP__IU__CREATE_DATE
PMCD__IU__UPDATE_DATE PMCD__IU__CREATE_DATE
PMCT__IU__UPDATE_DATE PMCT__IU__CREATE_DATE
PMDIST__IU__UPDATE_DATE PMDIST__IU__CREATE_DATE
PHY__IU__UPDATE_DATE PHY__IU__CREATE_DATE
UEV__IU__UPDATE_DATE UEV__IU__CREATE_DATE
SYSAI__IU__UPDATE_DATE SYSAI__IU__CREATE_DATE
SYSCR__IU__UPDATE_DATE SYSCR__IU__CREATE_DATE
UEF__IU__UPDATE_DATE UEF__IU__CREATE_DATE
UEFP__IU__UPDATE_DATE UEFP__IU__CREATE_DATE
OMCG__IU__UPDATE_DATE OMCG__IU__CREATE_DATE
JSGU__IU__CREATE_DATE JSGU__IU__CREATE_DATE
OMC__IU__CREATE_DATE OMC__IU__CREATE_DATE
WRL__IU__CREATE_DATE WRL__IU__CREATE_DATE
INV__IU__CREATE_DATE INV__IU__CREATE_DATE
JCGJ__IU__CREATE_DATE JCGJ__IU__CREATE_DATE
OMCT__IU__CREATE_DATE OMCT__IU__CREATE_DATE
OPUDF__IU__CREATE_DATE OPUDF__IU__CREATE_DATE
OMOPS__IU__CREATE_DATE OMOPS__IU__CREATE_DATE
SDPICKR__IU__CREATE_DATE SDPICKR__IU__CREATE_DATE
VDIST__IU__CREATE_DATE VDIST__IU__CREATE_DATE
INCIDENT_DATETIME
CORRECTION_DATE
CORRECTION_DATE
UPDATED CREATED
UPDATED CREATED
CORRECTION_DATE
UPDATED CREATED
UPDATED CREATED
UPDATED CREATED
UPDATED CREATED
REFRESH_DATE
UPDATED CREATED
UPDATED CREATED
UPDATED CREATED
UPDATED CREATED
TIMESTAMP
UPDATED CREATED
UPDATED CREATED
UPDATED CREATED
UPDATED CREATED
CREATED_AT
UPDATED CREATED
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
no watermark column N/A
created_at,updated_at N/A
no watermark column N/A
updated_at N/A
updated_at N/A
created_at,updated_at N/A
created_at,updated_at N/A
created_at,updated_at N/A
created_at,updated_at N/A
created_at,updated_at N/A
no watermark column N/A
created_at,updated_at N/A

created_at,updated_at N/A

created_at, updated_at N/A


N/A
N/A
date N/A

created_at,updated_at, revision N/A

created_at, updated_at N/A

created_at, updated_at N/A


UPDATED CREATED
ABALTYPE__IU__CREATE_DATE ABALTYPE__IU__UPDATE_DATE
ACC__IU__CREATE_DATE ACC__IU__UPDATE_DATE
ACCTYPE__IU__CREATE_DATE ACCTYPE__IU__UPDATE_DATE
BACURR__IU__CREATE_DATE BACURR__IU__UPDATE_DATE
BPCUST__IU__CREATE_DATE BPCUST__IU__UPDATE_DATE
CHQ__IU__CREATE_DATE CHQ__IU__UPDATE_DATE
CMD__IU__CREATE_DATE CMD__IU__UPDATE_DATE
CMD__IU__CREATE_DATE CMD__IU__UPDATE_DATE
CMD__IU__CREATE_DATE CMD__IU__UPDATE_DATE
CMDVD__IU__CREATE_DATE CMDVD__IU__UPDATE_DATE
CMDVD__IU__CREATE_DATE CMDVD__IU__UPDATE_DATE
CMDVD__IU__CREATE_DATE CMDVD__IU__UPDATE_DATE
CMM__IU__CREATE_DATE CMM__IU__UPDATE_DATE
CMM__IU__CREATE_DATE CMM__IU__UPDATE_DATE
CMM__IU__CREATE_DATE CMM__IU__UPDATE_DATE
CMOCN__IU__CREATE_DATE CMOCN__IU__UPDATE_DATE
CMST__IU__CREATE_DATE CMST__IU__UPDATE_DATE
CONSCHART__IU__CREATE_DATECONSCHART__IU__UPDATE_DATE
CUSTCLAS__IU__CREATE_DATE CUSTCLAS__IU__UPDATE_DATE
EMDT__IU__CREATE_DATE EMDT__IU__UPDATE_DATE
EMLH__IU__CREATE_DATE EMLH__IU__UPDATE_DATE
EMTC__IU__CREATE_DATE EMTC__IU__UPDATE_DATE
EMTR__IU__CREATE_DATE EMTR__IU__UPDATE_DATE
FAST__IU__CREATE_DATE FAST__IU__UPDATE_DATE
GL__IU__CREATE_DATE GL__IU__UPDATE_DATE
GLTAC__IU__CREATE_DATE GLTAC__IU__UPDATE_DATE
ICCF__IU__CREATE_DATE ICCF__IU__UPDATE_DATE
INSV__IU__CREATE_DATE INSV__IU__UPDATE_DATE
IPAY__IU__CREATE_DATE IPAY__IU__UPDATE_DATE
JBB__IU__CREATE_DATE JBB__IU__UPDATE_DATE
JBBD__IU__CREATE_DATE JBBD__IU__UPDATE_DATE
JBC__IU__CREATE_DATE JBC__IU__UPDATE_DATE
JBCDMS__IU__CREATE_DATE JBCDMS__IU__UPDATE_DATE
JBCD__IU__CREATE_DATE JBCD__IU__UPDATE_DATE
JBG__IU__CREATE_DATE JBG__IU__UPDATE_DATE
JCDT__IU__CREATE_DATE JCDT__IU__UPDATE_DATE
JCAT__IU__CREATE_DATE JCAT__IU__UPDATE_DATE
JSG__IU__CREATE_DATE JSG__IU__UPDATE_DATE
PHS__IU__CREATE_DATE PHS__IU__UPDATE_DATE
OPSTG__IU__CREATE_DATE OPSTG__IU__UPDATE_DATE
OMS__IU__CREATE_DATE OMS__IU__UPDATE_DATE
PAY__IU__CREATE_DATE PAY__IU__UPDATE_DATE
PMBICP__IU__CREATE_DATE PMBICP__IU__UPDATE_DATE
PMBPS__IU__CREATE_DATE PMBPS__IU__UPDATE_DATE
PMBPSD__IU__CREATE_DATE PMBPSD__IU__UPDATE_DATE
PMC__IU__CREATE_DATE PMC__IU__UPDATE_DATE
PMCV__IU__CREATE_DATE PMCV__IU__UPDATE_DATE
PMD__IU__CREATE_DATE PMD__IU__UPDATE_DATE
PMH__IU__CREATE_DATE PMH__IU__UPDATE_DATE
PMJ__IU__CREATE_DATE PMJ__IU__UPDATE_DATE
PMN__IU__CREATE_DATE PMN__IU__UPDATE_DATE
PMPI__IU__CREATE_DATE PMPI__IU__UPDATE_DATE
PMPP__IU__CREATE_DATE PMPP__IU__UPDATE_DATE
PMPPR__IU__CREATE_DATE PMPPR__IU__UPDATE_DATE
PMPR__IU__CREATE_DATE PMPR__IU__UPDATE_DATE
PMRFI__IU__CREATE_DATE PMRFI__IU__UPDATE_DATE
PMSM__IU__CREATE_DATE PMSM__IU__UPDATE_DATE
EMH__IU__CREATE_DATE EMH__IU__UPDATE_DATE
TSH__IU__CREATE_DATE TSH__IU__UPDATE_DATE
SCMST__IU__CREATE_DATE SCMST__IU__UPDATE_DATE
SCSCH__IU__CREATE_DATE SCSCH__IU__UPDATE_DATE
SDPICKH__IU__CREATE_DATE SDPICKH__IU__UPDATE_DATE
SPLS__IU__CREATE_DATE SPLS__IU__UPDATE_DATE
SUBLEDG__IU__CREATE_DATE SUBLEDG__IU__UPDATE_DATE
SYSAIR__IU__CREATE_DATE SYSAIR__IU__UPDATE_DATE
SYSOA__IU__CREATE_DATE SYSOA__IU__UPDATE_DATE
UE__IU__CREATE_DATE UE__IU__UPDATE_DATE
UE__IU__CREATE_DATE UE__IU__UPDATE_DATE
VCHQ__IU__CREATE_DATE VCHQ__IU__UPDATE_DATE
WC__IU__CREATE_DATE WC__IU__UPDATE_DATE
WM__IU__CREATE_DATE WM__IU__UPDATE_DATE
USERNAME__IU__CREATE_DATE USERNAME__IU__UPDATE_DATE
JOB__IU__CREATE_DATE JOB__IU__UPDATE_DATE
PROJ__IU__CREATE_DATE PROJ__IU__UPDATE_DATE
PROJ__IU__CREATE_DATE PROJ__IU__UPDATE_DATE
UPDATE__IU__CREATE_DATE UPDATE__IU__UPDATE_DATE
DEPT__IU__CREATE_DATE DEPT__IU__UPDATE_DATE
STATE__IU__CREATE_DATE STATE__IU__UPDATE_DATE

CREATION_DATE UPDATE_DATE
CAT__IU__CREATE_DATE CAT__IU__UPDATE_DATE
FCAT__IU__CREATE_DATE FCAT__IU__UPDATE_DATE
ORG__IU__CREATE_DATE ORG__IU__UPDATE_DATE
EMPM__IU__CREATE_DATE EMPM__IU__UPDATE_DATE
MEMT__IU__CREATE_DATE MEMT__IU__UPDATE_DATE
SYSCMH__IU__CREATE_DATE SYSCMH__IU__UPDATE_DATE
JHP__IU__CREATE_DATE JHP__IU__UPDATE_DATE
OMCT__IU__CREATE_DATE OMCT__IU__UPDATE_DATE
OMOC__IU__CREATE_DATE OMOC__IU__UPDATE_DATE
OMC__IU__CREATE_DATE OMC__IU__UPDATE_DATE
OMOMS__IU__CREATE_DATE OMOMS__IU__UPDATE_DATE
SDOA__IU__CREATE_DATE SDOA__IU__UPDATE_DATE
JCBAL__IU__CREATE_DATE JCBAL__IU__UPDATE_DATE
JCCF__IU__CREATE_DATE JCCF__IU__UPDATE_DATE
JCCFD__IU__CREATE_DATE JCCFD__IU__UPDATE_DATE
INSD__IU__CREATE_DATE INSD__IU__UPDATE_DATE
ESGU_IU_CREATE_DATE ESGU_IU_UPDATE_DATE
ESG_IU_CREATE_DATE ESG_IU_UPDATE_DATE
ROLE_IU_CREATE_DATE ROLE_IU_UPDATE_DATE
SD_IU_CREATE_DATE SD_IU_UPDATE_DATE
FMR_IU_CREATE_DATE FMR_IU_UPDATE_DATE
IGU_IU_CREATE_DATE IGU_IU_UPDATE_DATE
IGR_IU_CREATE_DATE IGR_IU_UPDATE_DATE
UROLE_IU_CREATE_DATE UROLE_IU_UPDATE_DATE
SDMC__IU__CREATE_DATE SDMC__IU__UPDATE_DATE
EMCOM_IU_CREATE_DATE EMCOM_IU_UPDATE_DATE
UED__IU__CREAT_DATE UED__IU__UPDATE_DATE
VPDEPT__IU_CREATE_DATE VPDEPT__IU__UPDATE_DATE
CREATE_TIMESTAMP LAST_UPDATE_USER
JOB__IU__CREATE_DATE JOB__IU__UPDATE_DATE
E__IU__CREATE_DATE E__IU__UPDATE_DATE

PAYTYP__IU__CREATE_DATE PAYTYP__IU__UPDATE_DATE
Load Type Incremental / Full Is Full Load Done? Is WW FL Data Validatation Done?

Yes Yes

Yes Yes

Yes Yes

Yes Yes
Yes Yes

Full

Yes Yes

Yes Yes
Yes Yes

Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
NA NA
Yes Yes
Yes Yes
NA NA
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes

Yes Yes

Yes Yes
Yes Yes
Yes Yes
Yes Yes

Yes Yes

Yes Yes

Yes Yes
Yes Yes

Full
Full

Full

Full

Full

Full
Full
Is WT FL Data Validation Done? Is Incremental Load Done?

Yes Yes

Yes Yes

Yes Yes

Yes Yes
Yes Yes

Yes Yes

Yes Yes
Yes Yes

Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes N/A
NA N/A
Yes N/A
Yes N/A
NA N/A
Yes N/A
Yes N/A
Yes N/A
Yes N/A
Yes N/A
Yes N/A
Yes N/A
Yes N/A
Yes N/A
Yes N/A
Yes N/A
Yes N/A
Yes N/A
Yes N/A
Yes N/A
Yes N/A
YTS Yes
YTS Yes
YTS Yes
YTS Yes
YTS Yes
YTS Yes
YTS Yes
YTS Yes
YTS Yes
YTS Yes
YTS Yes
YTS Yes

YTS Yes

YTS Yes
YTS Yes
YTS Yes
YTS Yes

YTS Yes

YTS Yes

YTS Yes
No Yes
Is WW IL Data Validatation Done? Is WT IL Data Validation Done? OPDG - Full Load Sprint #
Yes 10
Yes 10
Yes Yes 9
Yes 10
Yes Yes 9
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes Yes 9
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes Yes 9
Yes Yes 9
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 11
Yes 10
Yes 10
Yes 10
Yes 10
Yes Yes 9
Yes 10
Yes 10
Yes 10
Yes Yes 9
Yes Yes 9
Yes 10
Yes Yes 9
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes 10
Yes Yes 9
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
N/A N/A
Yes YTS
Yes YTS
Yes YTS
Yes YTS
Yes YTS
Yes YTS
Yes YTS
Yes YTS
Yes YTS
Yes YTS
Yes YTS
Yes YTS

Yes YTS

Yes YTS
Yes YTS
Yes YTS
Yes YTS

Yes YTS

Yes YTS

Yes YTS
Yes No

11
10
10
10
10
10
10
10
10
10
10
10
10
10
10
10
10
10
11
10
10
10
10
11
10
11
10
10
10
10
10
10
10
10
10
10
10
11
10
11
11
11
11
11
11
11
11
11
11
11
11
11
10
10
10
11
11
11
11
11
11
10
11
11
11
11
11
10
11
11
11
11
11
11
11
11
11

11
11
10
10
10
10
10
11
10
11
11
11
11
11
10
11
11
10
11
11
11
11
10
10
10
11
10
10
11
11
11
Is WW completed OPDG - Full Load? Is WW completed OPDG - Full Load Validation?
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes No
Y Y
Y Y
Y Y
Y Y
Yes Yes
Y Y
Y Y
Y Y
Yes Yes
Yes Yes
Y Y
Yes Yes
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Yes Yes
Yes Yes
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Yes Yes
Y Y
Y Y
Y Y
Y Y
Yes Yes
Y Y
Yes Yes
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Y Y
Yes Yes
Y Y
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Y Y
Y Y
Y Y
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Y Y
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Y Y
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes

Yes Yes
Yes Yes
Y Y
Y Y
Y Y
Y Y
Y Y
Yes Yes
Y Y
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Y Y
Yes Yes
Yes Yes
Y Y
Yes Yes
Yes Yes
Yes Yes
Yes Yes
Y Y
Y Y
Y Y
Yes Yes
Y Y
Y Y
Yes Yes
Yes Yes
Yes Yes
Is WT OPDG FL Data Validation Done? OPDG - Incremental Load Sprint #
10
10
Yes 9
10
Yes 9
10
10
10
10
10
Yes 9
10
10
10
10
10
10
10
10
10
10
10
10
10
10
Yes 9
Yes 9
10
10
10
10
10
11
10
10
10
10
Yes 9
10
10
10
Yes 9
Yes 9
10
Yes 9
10
10
10
10
10
10
10
10
10
10
10
10
10
Yes 9
11
10
10
10
10
10
10
10
10
10
10
10
10
10
10
10
10
10
11
10
10
10
10
11
10
11
10
10
10
10
10
10
10
10
10
10
10
11
10
11
11
11
11
11
11
11
11
11
11
11
11
11
10
10
10
11
11
11
11
11
11
10
11
11
11
11
11
10
11
11
11
11
11
11
11
11
11

11
11
10
10
10
10
10
11
10
11
11
11
11
11
10
11
11
10
11
11
11
11
10
10
10
11
10
10
11
11
11
Is WW completed OPDG - Incremental Load?
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Y
Y
Y
Y
Yes
Y
Y
Y
Yes
Yes
Y
Yes
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Yes
Yes
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Yes
Y
Y
Y
Y
Yes
Y
Yes
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Yes
Y
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Y
Y
Y
Yes
Yes
Yes
Yes
Yes
Yes
Y
Yes
Yes
Yes
Yes
Yes
Y
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes

Yes
Yes
Y
Y
Y
Y
Y
Yes
Y
Yes
Yes
Yes
Yes
Yes
Y
Yes
Yes
Y
Yes
Yes
Yes
Yes
Y
Y
Y
Yes
Y
Y
Yes
Yes
Yes
Is WW completed OPDG - Incremental Load Validation?
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Y
Y
Y
Y
Yes
Y
Y
Y
Yes
Yes
Y
Yes
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Yes
Yes
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Yes
Y
Y
Y
Y
Yes
Y
Yes
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Y
Yes
Y
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Y
Y
Y
Yes
Yes
Yes
Yes
Yes
Yes
Y
Yes
Yes
Yes
Yes
Yes
Y
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes
Yes

Yes
Yes
Y
Y
Y
Y
Y
Yes
Y
Yes
Yes
Yes
Yes
Yes
Y
Yes
Yes
Y
Yes
Yes
Yes
Yes
Y
Y
Y
Yes
Y
Y
Yes
Yes
Yes
Is WT completed OPDG - Incremental Load Data Validation?

Yes

Yes

Yes

Yes
Yes

Yes

Yes
Yes

Yes
Yes
Notes
Able to parse schema -> prc_admin_equipment_list, good until gold
able to parse schema -> prc_checklist_inspection_schedules_list, good until gold
able to parse schema->prc_checklist_inspections_sections_list, good until gold
able to parse schema-> prc_checklist_sections, good until gold
able to parse schema-> prc_checklist_sections_list, good until gold
in progress. able to parse schema-> prc_construction_report_logs , good until gold
able to parse schema-> prc_forms_list, good until gold
able to parse schema-> prc_incidents, good until gold
able to parse schema-> prc_observations_list, good until gold
able to parse schema-> prc_rfis_list, good until gold
able to parse schema-> prc_meetings_list, in progress
Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 5 in
able
stageto27.0
parse schema->
failed 4 times,prc_project_permission_manifest_list, in progress
most recent failure: Lost task 5.3 in stage 27.0 (TID 189) (vm-
47946987 executor 2): org.apache.spark.SparkException: Parquet column cannot be
converted in file abfss://e165d8f3-7a79-4a3b-b3b8-
fddc1391b133@onelake.dfs.fabric.microsoft.com/59bdf0ab-2f7f-45eb-8124-
d7df81f7628d/Files/bronze_stg/InputFiles/Procore/DOCUMENTS%20LIST/
Procore_Documents%5BList%5D_020406-CyrusOne_041724.parquet. Column:
[created_by.locale], Expected: string, Found: DOUBLE.
ErrorCode=: Parquet complex types of STRUCT, LIST and MAP are not supported.
next
ErrorCode=: Parquet complex types of STRUCT, LIST and MAP are not supported. next
Parquet complex types of STRUCT, LIST and MAP are not supported next
Column: [date], Expected: string, Found: DOUBLE
SUBMITTALS%20LIST/Procore_Submittals%5BList%5D_019810-ProjectSCF
%20041924.parquet. Column: [number], Expected: double, Found: BINARY.

ErrorCode=TypeConversionFailure,Exception occurred when converting value 'W2.4&5-09


(2-15-24)' for column name 'wbs' from type 'String' (precision:-1, scale:-1) to type 'Double'
(precision:-1, scale:-1). Additional info: Input string was not in a correct format.
ErrorCode=TypeConversionFailure,Exception occurred when converting value '' for
column name 'employee_id' from type 'String' (precision:-1, scale:-1) to type 'Double'
(precision:-1, scale:-1). Additional info: Input string was not in a correct format.
Duplicate

Updated to Full Load as per 8/9 discussion

Updated to Full Load as per 8/9 discussion

OWNER might be JS75 as JSJ75 not exists


Updated to Full Load as per 8/9 discussion

Updated to Full Load as per 8/12 discussion

Updated to Full Load as per 8/12 discussion


Updated to Full Load as per 8/12 discussion

You might also like