Ivan Lee

Can't use case class in the Scala notebook

4

the version of docker: jupyter/all-spark-notebook:lastest the way to start docker: docker run -it --rm -p 8888:8888 jupyter/all-spark-notebook:latest or docker ps -a docker start -i containerID the steps: Visit http://localhost:8888 Start...

import gpt-2 model into spark nlp.

2

I trained a gpt-2 model fine-tuned by huggingface. How could I import this model into spark nlp? please give some idea, appreciate it.

'NoneType' object has no attribute 'setInputCols'

2

## Description documentAssembler = DocumentAssembler() \ .setInputCol("text") \ .setOutputCol("documents") gpt2 = GPT2Transformer.pretrained("gpt2_large") \ .setInputCols(["documents"]) \ .setMaxOutputLength(50) \ .setOutputCol("generation") pipeline = Pipeline().setStages([documentAssembler, gpt2]) data = spark.createDataFrame([["My name is Leonardo."]]).toDF("text") result =...

How to load fine-tuned model and to predict?

2

How to load fine-tuned model and to predict? Please show me some examples, thanks.

./chia_recompute_proxy_http -n harv01 -n harv02-r 10 -d There are two GPUs, one 3060 and one 3060 Ti. How should the -r parameter of chia_recompute_proxy_http be set? Is it better to...

class 'asyncio.exceptions.TimeoutError'

1

2023-08-13T20:10:37.405 harvester harvester_server : ERROR Exception: , > File "/home/leeivan/chia-gigahorse-farmer/chia/server/ws_connection.py", line 408, in _api_call File "/home/leeivan/chia-gigahorse-farmer/asyncio/tasks.py", line 501, in wait_for asyncio.exceptions.TimeoutError