ocean

Results 36 comments of ocean

> 需要部署通信服务(pulsar或rabbitmq), 然后修改conf/service_conf.yaml: (1)fateflow命令通道: a. 直连方式 > > ```yaml > fateflow: > proxy: > name: fateflow > host: xx > http_port: xx > grpc_port: xx > ``` > > b....

反馈: 此问题是因为防火墙没有关闭导致的,关闭防火墙后次问题解决。

> 需要部署通信服务(pulsar或rabbitmq), 然后修改conf/service_conf.yaml: (1)fateflow命令通道: a. 直连方式 > > ```yaml > fateflow: > proxy: > name: fateflow > host: xx > http_port: xx > grpc_port: xx > ``` > > b....

https://github.com/secretflow/secretflow/blob/main/secretflow/ml/nn/fl/fl_model.py `fit()函数中 client_param_list.append(client_params) #此处为将client本地训练的模型参数加入表单?用来后续做聚合? sample_num_list.append(sample_num) ` ![image](https://github.com/secretflow/secretflow/assets/49178688/4e6bd5b5-74bb-4717-b5c1-01b38e37af99)

根据您给的建议,我在使用水平联邦学习时在fit函数中手动打印了日志。 水平联邦参考:https://www.secretflow.org.cn/zh-CN/docs/secretflow/v1.4.0b0/tutorial/Federate_Learning_for_Image_Classification#%E6%B0%B4%E5%B9%B3%E8%81%94%E9%82%A6%EF%BC%9A%E5%9B%BE%E5%83%8F%E5%88%86%E7%B1%BB 我做了如下改动: 修改了https://github.com/secretflow/secretflow/blob/main/secretflow/ml/nn/fl/fl_model.py#L336 中的fit函数,在某些地方手动打印了日志,增加代码如下: https://github.com/secretflow/secretflow/blob/3b3c6e9181dce4d4a44614c46cee9cfb0eb8c393/secretflow/ml/nn/fl/fl_model.py#L509 在509行进行了日志打印,如图所示增加了以下代码: ![image](https://github.com/secretflow/secretflow/assets/49178688/03ee95a2-12f4-48a4-98b0-8982dc0bffa7) ` if step ==0: for i in range(len(client_param_list)): client_param_list[i].device(logging.info)(f'{client_param_list.device} model params is:\n %s ',client_param_list[i]) ` 执行水平联邦后查看日志,发现结果如下: alice: ![image](https://github.com/secretflow/secretflow/assets/49178688/c48a8b9b-502d-4966-82c3-738c26e6e05d) bob: ![image](https://github.com/secretflow/secretflow/assets/49178688/05bb484c-2a82-4981-8966-52384f46e76c) 按照我的理解,此处打印的日志应该是 alice和bob在本地训练的模型参数,现在打印出来发现两方的本地参数几乎一致,请问这是合理的吗?

我感觉应该是你的/homo-lr-normal-predict-dsl.json存在问题,在使用host部署的时候应该修改一些内容,不是和guest完全一样的。

> 我感觉是不是在你加载之前需要导入一下模型?例如这样 flow model import -c examples/model/import_model.json 我之前都是在guest方进行的,host方我也没有实验过。

> > os:ubuntu20.04 依赖配置参照:https://github.com/secretflow/devtools/blob/main/dockerfiles/ubuntu-base-ci.DockerFile 执行编译命令: `bazel build //... -c opt` 产生问题: 在此处一直卡住不动 ![image](https://private-user-images.githubusercontent.com/49178688/322378170-ee39966b-26e1-4e8f-b8ed-efdc9832dd58.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTMxNjUzMjIsIm5iZiI6MTcxMzE2NTAyMiwicGF0aCI6Ii80OTE3ODY4OC8zMjIzNzgxNzAtZWUzOTk2NmItMjZlMS00ZThmLWI4ZWQtZWZkYzk4MzJkZDU4LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA0MTUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNDE1VDA3MTAyMlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWQzYzgxZGI0YWJjOGU4OTgxZTU4NGZiZDZkZDNlNGM0NjQ3ZGFlYzEwMTZhNDdlZGYzZTQ5ZjZmYWU0MzMxYmQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.HKusRBFs_wpVpdL-OFf9qt54MSUjZ-AQi4MIEaoKKTs) > > 请问编译机器的配置是啥呀 @anakinxc 机器配置:64c 256G

> > > > os:ubuntu20.04 依赖配置参照:https://github.com/secretflow/devtools/blob/main/dockerfiles/ubuntu-base-ci.DockerFile 执行编译命令: `bazel build //... -c opt` 产生问题: 在此处一直卡住不动 ![image](https://private-user-images.githubusercontent.com/49178688/322378170-ee39966b-26e1-4e8f-b8ed-efdc9832dd58.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTMxNjUzMjIsIm5iZiI6MTcxMzE2NTAyMiwicGF0aCI6Ii80OTE3ODY4OC8zMjIzNzgxNzAtZWUzOTk2NmItMjZlMS00ZThmLWI4ZWQtZWZkYzk4MzJkZDU4LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA0MTUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNDE1VDA3MTAyMlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWQzYzgxZGI0YWJjOGU4OTgxZTU4NGZiZDZkZDNlNGM0NjQ3ZGFlYzEwMTZhNDdlZGYzZTQ5ZjZmYWU0MzMxYmQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.HKusRBFs_wpVpdL-OFf9qt54MSUjZ-AQi4MIEaoKKTs) > > > > > > > > > 请问编译机器的配置是啥呀 > > > > >...

> 可以问下 cpu 是哪种吗? @Jamie-Cui cpu种类 ![image](https://github.com/secretflow/yacl/assets/49178688/c8c7cda8-deda-49f4-8661-c449421cba5f)