One question on categorical dtypes came up while working on categorical metadata - #10 (comment):

What needed to be done also is to separately define the dtype for categorical columns (in Vaex dtype of a categorical column is the dtype of data itself). I am not sure if the default is correct:

(_DtypeKind.CATEGORICAL, 64, 'u', '=')

vaex-df-api-implementation/notebook_research/vaex_implementation_v11.py

Lines 288 to 292 in 1002192

    
           # Categorical 
        
           # If it is internal, kind is categorical (23) 
        
           # If it is external (call from_dataframe) must give data dtype 
        
           if self._col.df.is_category(self._col): 
        
               return (_DtypeKind.CATEGORICAL, 64, 'u', '=') # what should be the default??

Ralf pointed me to an open issue in the general dataframe-api:

data-apis/dataframe-api#49 (comment)
data-apis/dataframe-api#46 (comment)

	# Categorical
	# If it is internal, kind is categorical (23)
	# If it is external (call from_dataframe) must give data dtype
	if self._col.df.is_category(self._col):
	return (_DtypeKind.CATEGORICAL, 64, 'u', '=') # what should be the default??

Description

Metadata

Metadata

Assignees

Labels

Projects

Milestone

Relationships

Development

Issue actions