-
Notifications
You must be signed in to change notification settings - Fork 36
Description
Hi Chris starting a thread on the way one could achieve type-hint style syntax and a static-analysis checks on column names for data frames. This is something that seems hard for Pandas to support, defining custom Pandera's schema's are hard to configure typing for and there are so many restrictions on their schema validators that can quite easily be achieved with custom defined validation where needed.
Imagine one is in a part of the system whose data comes in at runtime, the system knows a data frame is available and all python objects are subsequently type hinted, but the column names of the data frame.
How would you approach this? It seems like a defining a meta structure is required, but I am trying to think through a simple way of going about this. This also seems perfect for static-frame to support given the values of immutability.