Ziming Mao

### What happened + What you expected to happen Delay between Ray task scheduling and execution. Observing this issue for tasks that require GPUs, but not CPUs. If I change...

Tested (run the relevant ones): - [ ] Code formatting: `bash format.sh` - [ ] Any manual or new tests for this PR (please specify below) - [ ] All...

Getting `error: ‘XDP_RING_NEED_WAKEUP’ was not declared in this scope`

3

After I run `./getdeps.sh`, I got: ``` /home/maoziming/mvfst/quic/xsk/XskSender.cpp: In member function ‘facebook::xdpsocket::FlushResult facebook::xdpsocket::XskSender::flush()’: /home/maoziming/mvfst/quic/xsk/XskSender.cpp:231:65: error: ‘struct xdp_ring_offset’ has no member named ‘flags’ auto* txFlagsPtr = (uint32_t*)((char*)txMap_ + xskOffsets_.tx.flags); ^~~~~ /home/maoziming/mvfst/quic/xsk/XskSender.cpp:233:16:...

Added a YAML example for multi-node serving Llama-2-70b-hf, on 2 node A100:2. Tested (run the relevant ones): - [x] Code formatting: `bash format.sh` - [ ] Any manual or new...

Build fails on debian-10

1

**Describe the bug** Build fails with ``` In member function ‘virtual void folly::AsyncSocket::writeChain(folly::AsyncWriter::WriteCallback*, std::unique_ptr&&, folly::WriteFlags)’: /home/CacheLib/cachelib/external/folly/folly/io/async/AsyncSocket.cpp:1733:15: error: ‘BOOST_PP_IF’ was not declared in this scope iovec vec[BOOST_PP_IF(FOLLY_HAVE_VLA_01, count, kSmallIoVecSize)]; ^~~~~~~~~~~ /home/CacheLib/cachelib/external/folly/folly/io/async/AsyncSocket.cpp:1733:15:...

[Serve] Wait for fallback replicas to be ready before scaling down the old replicas.

5

We should make sure the fallback replicas are ready before scaling down the old replicas to avoid the situation that all the ready new replicas are preempted together.

`memcached_set` returns `MEMCACHED_NOTFOUND`

1

I am getting weird `memcached_return_t` (`MEMCACHED_NOTFOUND`) after calling `memcached_set`. If I understand it correctly, `MEMCACHED_NOTFOUND` should only apply to `memcached_get`. Do you know what kind of situations where `memcached_set` could...

Does not seem to read your write.

1

I have some code structured in this way: ``` memcached_return_t set_result; set_result = memcached_set(memc, request->key().c_str(), request->key().size(), db_value.c_str(), db_value.size(), (time_t)ttl_, (uint32_t)0); assert(set_result == MEMCACHED_SUCCESS); memcached_return_t get_result; char *value = memcached_get(memc, request->key().c_str(),...

``` resources: accelerators: # Fill in the accelerator type cpus: 16+ memory: 32+ ```

Can the current cpp client handle TLS connection to PD?