retrieve_fields function error

Former User of DNAx Community_19

I encountered an error while executing the 'ukb-rap-pheno-basic.ipynb' script. The issue arises at the line `df = participant.retrieve_fields(names=field_names, engine=dxdata.connect())`. The specific error message is as follows:

```

---------------------------------------------------------------------------

ValueError Traceback (most recent call last)

Cell In[27], line 1

----> 1 df = participant.retrieve_fields(fields=field_names, engine=dxdata.connect())

 

File /opt/conda/lib/python3.9/site-packages/dxdata/dataset/dataset.py:2018, in Entity.retrieve_fields(self, engine, fields, names, titles, filter_sql, coding_values, limit, column_aliases, array_as_string)

1984 def retrieve_fields(self, engine, fields=None, names=None, titles=None,

1985 filter_sql=None, coding_values="raw", limit=None,

1986 column_aliases=None, array_as_string=False):

1988 """Build and execute SQL to retrieve fields' database column values.

1989

1990 Args:

(...)

2015 Returns: Spark dataframe

2016 """

-> 2018 return retrieve_fields(engine=engine, dataset=self.dataset, entity_name=self.name,

2019 fields=fields, names=names, titles=titles, filter_sql=filter_sql,

2020 coding_values=coding_values, limit=limit, column_aliases=column_aliases,

2021 array_as_string=array_as_string)

 

File /opt/conda/lib/python3.9/site-packages/dxdata/dataset/dataset.py:84, in retrieve_fields(engine, dataset, entity_name, fields, names, titles, field_alias_map, filter_sql, coding_values, limit, column_aliases, array_as_string)

81 from ..engine.base import HivePysparkEngine

82 if not isinstance(engine, HivePysparkEngine):

83 # Engine might be of type HiveEngine i.e using thrift connection

---> 84 raise ValueError("retrieve_fields is only supported using a spark connection."

85 "Thrift connection is not supported. Check your engine connection"

86 " setting or environment.")

88 if not dataset:

89 raise ValueError("Dataset should be specified")

 

ValueError: retrieve_fields is only supported using a spark connection.Thrift connection is not supported. Check your engine connection setting or environment.

```

Comments

2 comments

Date Votes

Please sign in to leave a comment.