Problem: I have a twitter dataset with nested structures in a mongo database that I'm not able to load as a blaze Table:
In [5]: discover(data[0])
Out[5]: dshape("(null, null, datetime, { hashtags : var * string, symbols : var * string, trends : var * string, urls : var * string, user_mentions : var * string }, int64, bool, string, null, int64, int64, null, null, null, null, null, string, null, bool, int64, bool, string, string, int64, bool, { contributors_enabled : bool, created_at : datetime, default_profile : bool, default_profile_image : bool, description : string, favourites_count : int64, follow_request_sent : null, followers_count : int64, following : null, friends_count : int64, geo_enabled : bool, id : int64, id_str : int64, is_translator : bool, lang : string, listed_count : int64, location : string, name : string, notifications : null, profile_background_color : int64, profile_background_image_url : string, profile_background_image_url_https : string, profile_background_tile : bool, profile_banner_url : string, profile_image_url : string, profile_image_url_https : string, profile_link_color : string, profile_sidebar_border_color : string, profile_sidebar_fill_color : string, profile_text_color : int64, profile_use_background_image : bool, protected : bool, screen_name : string, statuses_count : int64, time_zone : string, url : string, utc_offset : int64, verified : bool })")
In [6]: discover(data[1])
Out[6]: dshape("(null, null, datetime, { hashtags : var * string, symbols : var * string, trends : var * string, urls : var * string, user_mentions : var * string }, int64, bool, string, null, int64, int64, null, null, null, null, null, string, null, bool, int64, bool, string, string, int64, bool, { contributors_enabled : bool, created_at : datetime, default_profile : bool, default_profile_image : bool, description : null, favourites_count : int64, follow_request_sent : null, followers_count : int64, following : null, friends_count : int64, geo_enabled : bool, id : int64, id_str : int64, is_translator : bool, lang : string, listed_count : int64, location : null, name : string, notifications : null, profile_background_color : string, profile_background_image_url : string, profile_background_image_url_https : string, profile_background_tile : bool, profile_banner_url : string, profile_image_url : string, profile_image_url_https : string, profile_link_color : string, profile_sidebar_border_color : string, profile_sidebar_fill_color : string, profile_text_color : int64, profile_use_background_image : bool, protected : bool, screen_name : string, statuses_count : int64, time_zone : string, url : null, utc_offset : int64, verified : bool })")
In [7]: discover(data[2])
Out[7]: dshape("(null, null, datetime, { hashtags : var * string, symbols : var * string, trends : var * string, urls : var * string, user_mentions : var * string }, int64, bool, string, null, int64, int64, null, null, null, null, null, string, null, bool, int64, bool, string, string, int64, bool, { contributors_enabled : bool, created_at : datetime, default_profile : bool, default_profile_image : bool, description : string, favourites_count : int64, follow_request_sent : null, followers_count : int64, following : null, friends_count : int64, geo_enabled : bool, id : int64, id_str : int64, is_translator : bool, lang : string, listed_count : int64, location : string, name : string, notifications : null, profile_background_color : string, profile_background_image_url : string, profile_background_image_url_https : string, profile_background_tile : bool, profile_banner_url : string, profile_image_url : string, profile_image_url_https : string, profile_link_color : int64, profile_sidebar_border_color : string, profile_sidebar_fill_color : string, profile_text_color : int64, profile_use_background_image : bool, protected : bool, screen_name : string, statuses_count : int64, time_zone : string, url : string, utc_offset : int64, verified : bool })")
Problem: I have a twitter dataset with nested structures in a mongo database that I'm not able to load as a blaze Table:
Error:
More infomation:
Discover on some rows:
Data structure in mongodb of the first tweet:
cc: @mrocklin