Commit 672c076
chore: merge unstable into sel-alternative (#19)
* Optimise `state_root_at_slot` for finalized slot (sigp#8353)
This is an optimisation targeted at Fulu networks in non-finality.
While debugging on Holesky, we found that `state_root_at_slot` was being called from `prepare_beacon_proposer` a lot, for the finalized state:
https://github.com/sigp/lighthouse/blob/2c9b670f5d313450252c6cb40a5ee34802d54fef/beacon_node/http_api/src/lib.rs#L3860-L3861
This was causing `prepare_beacon_proposer` calls to take upwards of 5 seconds, sometimes 10 seconds, because it would trigger _multiple_ beacon state loads in order to iterate back to the finalized slot. Ideally, loading the finalized state should be quick because we keep it cached in the state cache (technically we keep the split state, but they usually coincide). Instead we are computing the finalized state root separately (slow), and then loading the state from the cache (fast).
Although it would be possible to make the API faster by removing the `state_root_at_slot` call, I believe it's simpler to change `state_root_at_slot` itself and remove the footgun. Devs rightly expect operations involving the finalized state to be fast.
Co-Authored-By: Michael Sproul <michael@sigmaprime.io>
* Remove Windows CI jobs (sigp#8362)
Remove all Windows-related CI jobs
Co-Authored-By: antondlr <anton@sigmaprime.io>
* Update proposer-only section in the documentation (sigp#8358)
Co-Authored-By: Tan Chee Keong <tanck@sigmaprime.io>
Co-Authored-By: Michael Sproul <michaelsproul@users.noreply.github.com>
* Fix unaggregated delay metric (sigp#8366)
while working on this sigp#7892 @michaelsproul pointed it might be a good metric to measure the delay from start of the slot instead of the current `slot_duration / 3`, since the attestations duties start before the `1/3rd` mark now with the change in the link PR.
Co-Authored-By: hopinheimer <knmanas6@gmail.com>
Co-Authored-By: hopinheimer <48147533+hopinheimer@users.noreply.github.com>
* Downgrade and remove unnecessary logs (sigp#8367)
### Downgrade a non error to `Debug`
I noticed this error on one of our hoodi nodes:
```
Nov 04 05:13:38.892 ERROR Error during data column reconstruction block_root: 0x4271b9efae7deccec3989bd2418e998b83ce8144210c2b17200abb62b7951190, error: DuplicateFullyImported(0x4271b9efae7deccec3989bd2418e998b83ce8144210c2b17200abb62b7951190)
```
This shouldn't be logged as an error and it's due to a normal race condition, and it doesn't impact the node negatively.
### Remove spammy logs
This logs is filling up the log files quite quickly and it is also something we'd expect during normal operation - getting columns via EL before gossip. We haven't found this debug log to be useful, so I propose we remove it to avoid spamming debug logs.
```
Received already available column sidecar. Ignoring the column sidecar
```
In the process of removing this, I noticed we aren't propagating the validation result, which I think we should so I've added this. The impact should be quite minimal - the message will stay in the gossip memcache for a bit longer but should be evicted in the next heartbeat.
Co-Authored-By: Jimmy Chen <jchen.tc@gmail.com>
* Prepare `sensitive_url` for `crates.io` (sigp#8223)
Another good candidate for publishing separately from Lighthouse is `sensitive_url` as it's a general utility crate and not related to Ethereum. This PR prepares it to be spun out into its own crate.
I've made the `full` field on `SensitiveUrl` private and instead provided an explicit getter called `.expose_full()`. It's a bit ugly for the diff but I prefer the explicit nature of the getter.
I've also added some extra tests and doc strings along with feature gating `Serialize` and `Deserialize` implementations behind the `serde` feature.
Co-Authored-By: Mac L <mjladson@pm.me>
* Remove ecdsa feature of libp2p (sigp#8374)
This compiles, is there any reason to keep `ecdsa`? CC @jxs
Co-Authored-By: Michael Sproul <michael@sigmaprime.io>
* CI workflows to use warpbuild ci runner (sigp#8343)
Self hosted GitHub Runners review and improvements
local testnet workflow now uses warpbuild ci runner
Co-Authored-By: lemon <snyxmk@gmail.com>
Co-Authored-By: antondlr <anton@sigmaprime.io>
* Remove `sensitive_url` and import from `crates.io` (sigp#8377)
Use the recently published `sensitive_url` and remove it from Lighthouse
Co-Authored-By: Mac L <mjladson@pm.me>
* Migrate derivative to educe (sigp#8125)
Fixes sigp#7001.
Mostly mechanical replacement of `derivative` attributes with `educe` ones.
### **Attribute Syntax Changes**
```rust
// Bounds: = "..." → (...)
#[derivative(Hash(bound = "E: EthSpec"))]
#[educe(Hash(bound(E: EthSpec)))]
// Ignore: = "ignore" → (ignore)
#[derivative(PartialEq = "ignore")]
#[educe(PartialEq(ignore))]
// Default values: value = "..." → expression = ...
#[derivative(Default(value = "ForkName::Base"))]
#[educe(Default(expression = ForkName::Base))]
// Methods: format_with/compare_with = "..." → method(...)
#[derivative(Debug(format_with = "fmt_peer_set_as_len"))]
#[educe(Debug(method(fmt_peer_set_as_len)))]
// Empty bounds: removed entirely, educe can infer appropriate bounds
#[derivative(Default(bound = ""))]
#[educe(Default)]
// Transparent debug: manual implementation (educe doesn't support it)
#[derivative(Debug = "transparent")]
// Replaced with manual Debug impl that delegates to inner field
```
**Note**: Some bounds use strings (`bound("E: EthSpec")`) for superstruct compatibility (`expected ','` errors).
Co-Authored-By: Javier Chávarri <javier.chavarri@gmail.com>
Co-Authored-By: Mac L <mjladson@pm.me>
* Fix flaky reconstruction test (sigp#8321)
FIx flaky tests that depends on timing. Previously the test processes all 128 columns and expect reconstruction to happen after all columns are processed. There is a race here, and reconstruction could be triggered before all columns are processed.
I've updated the tests to process 64 columns, just enough for reconstruction and wait for 50ms for reconstruction to be triggered.
This PR requires the change made in sigp#8194 for the test to pass consistently (blob count set to 1 for all blocks instead of random blob count between 0..max)
Co-Authored-By: Jimmy Chen <jchen.tc@gmail.com>
Co-Authored-By: Jimmy Chen <jimmy@sigmaprime.io>
* Remove `ethers-core` from `execution_layer` (sigp#8149)
sigp#6022
Use `alloy_rpc_types::Transaction` to replace the `ethers_core::Transaction` inside the execution block generator.
Co-Authored-By: Mac L <mjladson@pm.me>
* Include block root in publish block logs (sigp#8111)
Debugging sigp#8104 it would have been helpful to quickly see in the logs that a specific block was submitted into the HTTP API.
Because we want to optimize the block root computation we don't include it in the logs, and just log the block slot. I believe we can take a minute performance hit to have the block root in all the logs during block publishing.
Co-Authored-By: dapplion <35266934+dapplion@users.noreply.github.com>
Co-Authored-By: Jimmy Chen <jchen.tc@gmail.com>
* fix: clarify `bb` vs `bl` variable names in BeaconProcessorQueue (sigp#8315)
since block and blob both start with `bl`, it was not clear how to differentiate between `blbroots_queue` and `bbroots_queue`
After renaming, there also seems to be a discrepancy
Co-Authored-By: Kevaundray Wedderburn <kevtheappdev@gmail.com>
* Migrate the `deposit_contract` crate to `alloy` (sigp#8139)
sigp#6022
Switches the `deposit_contract` crate to use the `alloy` ecosystem and removes the dependency on `ethabi`
Co-Authored-By: Mac L <mjladson@pm.me>
---------
Co-authored-by: Michael Sproul <michaelsproul@users.noreply.github.com>
Co-authored-by: Michael Sproul <michael@sigmaprime.io>
Co-authored-by: antondlr <anton@sigmaprime.io>
Co-authored-by: chonghe <44791194+chong-he@users.noreply.github.com>
Co-authored-by: hopinheimer <48147533+hopinheimer@users.noreply.github.com>
Co-authored-by: Jimmy Chen <jimmy@sigmaprime.io>
Co-authored-by: Jimmy Chen <jchen.tc@gmail.com>
Co-authored-by: Mac L <mjladson@pm.me>
Co-authored-by: lmnzx <snyxmk@gmail.com>
Co-authored-by: Javier Chávarri <javier.chavarri@gmail.com>
Co-authored-by: Lion - dapplion <35266934+dapplion@users.noreply.github.com>1 parent 3680ba9 commit 672c076
File tree
91 files changed
+1052
-1015
lines changed- .github/workflows
- beacon_node
- beacon_chain
- src
- tests
- beacon_processor/src
- builder_client/src
- execution_layer
- src
- engine_api
- test_utils
- http_api/src
- lighthouse_network
- network
- src
- network_beacon_processor
- sync
- block_lookups
- operation_pool
- src
- book/src
- common
- deposit_contract
- src
- eth2
- src
- lighthouse_vc
- monitoring_api/src
- sensitive_url
- src
- validator_dir
- src
- consensus
- state_processing
- src
- types
- src
- beacon_state
- crypto/kzg
- src
- lighthouse/tests
- slasher
- src/database
- testing
- ef_tests
- src
- execution_engine_integration/src
- simulator
- validator_client/beacon_node_fallback/src
- validator_manager
- src
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
91 files changed
+1052
-1015
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
14 | 14 | | |
15 | 15 | | |
16 | 16 | | |
17 | | - | |
| 17 | + | |
18 | 18 | | |
19 | 19 | | |
20 | 20 | | |
| |||
31 | 31 | | |
32 | 32 | | |
33 | 33 | | |
34 | | - | |
| 34 | + | |
35 | 35 | | |
36 | 36 | | |
37 | 37 | | |
| |||
89 | 89 | | |
90 | 90 | | |
91 | 91 | | |
92 | | - | |
| 92 | + | |
93 | 93 | | |
94 | 94 | | |
95 | 95 | | |
| |||
100 | 100 | | |
101 | 101 | | |
102 | 102 | | |
103 | | - | |
| 103 | + | |
104 | 104 | | |
105 | 105 | | |
106 | 106 | | |
| |||
136 | 136 | | |
137 | 137 | | |
138 | 138 | | |
139 | | - | |
| 139 | + | |
140 | 140 | | |
141 | 141 | | |
142 | 142 | | |
| |||
173 | 173 | | |
174 | 174 | | |
175 | 175 | | |
176 | | - | |
| 176 | + | |
177 | 177 | | |
178 | 178 | | |
179 | 179 | | |
| |||
216 | 216 | | |
217 | 217 | | |
218 | 218 | | |
219 | | - | |
| 219 | + | |
220 | 220 | | |
221 | 221 | | |
222 | 222 | | |
| |||
259 | 259 | | |
260 | 260 | | |
261 | 261 | | |
262 | | - | |
| 262 | + | |
263 | 263 | | |
264 | 264 | | |
265 | 265 | | |
| |||
272 | 272 | | |
273 | 273 | | |
274 | 274 | | |
275 | | - | |
| 275 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
32 | 32 | | |
33 | 33 | | |
34 | 34 | | |
35 | | - | |
36 | | - | |
| 35 | + | |
37 | 36 | | |
38 | 37 | | |
39 | 38 | | |
| |||
44 | 43 | | |
45 | 44 | | |
46 | 45 | | |
47 | | - | |
48 | | - | |
49 | | - | |
50 | 46 | | |
51 | 47 | | |
52 | 48 | | |
| |||
57 | 53 | | |
58 | 54 | | |
59 | 55 | | |
60 | | - | |
61 | | - | |
62 | | - | |
63 | | - | |
64 | | - | |
65 | | - | |
66 | | - | |
67 | | - | |
68 | | - | |
69 | | - | |
70 | | - | |
71 | | - | |
72 | | - | |
73 | 56 | | |
74 | 57 | | |
75 | 58 | | |
| |||
94 | 77 | | |
95 | 78 | | |
96 | 79 | | |
97 | | - | |
98 | | - | |
99 | | - | |
100 | | - | |
101 | 80 | | |
102 | | - | |
103 | 81 | | |
104 | 82 | | |
105 | 83 | | |
| |||
118 | 96 | | |
119 | 97 | | |
120 | 98 | | |
121 | | - | |
122 | | - | |
123 | | - | |
124 | | - | |
125 | | - | |
126 | | - | |
127 | | - | |
128 | | - | |
129 | | - | |
130 | | - | |
131 | | - | |
132 | | - | |
133 | | - | |
134 | | - | |
135 | 99 | | |
136 | 100 | | |
137 | 101 | | |
| |||
239 | 203 | | |
240 | 204 | | |
241 | 205 | | |
242 | | - | |
243 | 206 | | |
244 | 207 | | |
245 | 208 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
22 | 22 | | |
23 | 23 | | |
24 | 24 | | |
25 | | - | |
26 | | - | |
27 | 25 | | |
28 | 26 | | |
29 | 27 | | |
| |||
78 | 76 | | |
79 | 77 | | |
80 | 78 | | |
81 | | - | |
82 | | - | |
| 79 | + | |
83 | 80 | | |
84 | 81 | | |
85 | 82 | | |
| |||
88 | 85 | | |
89 | 86 | | |
90 | 87 | | |
91 | | - | |
92 | 88 | | |
93 | 89 | | |
94 | 90 | | |
| |||
97 | 93 | | |
98 | 94 | | |
99 | 95 | | |
100 | | - | |
101 | 96 | | |
102 | 97 | | |
103 | 98 | | |
| |||
107 | 102 | | |
108 | 103 | | |
109 | 104 | | |
110 | | - | |
111 | | - | |
112 | | - | |
113 | | - | |
114 | | - | |
115 | | - | |
116 | | - | |
117 | | - | |
118 | | - | |
119 | | - | |
120 | | - | |
121 | | - | |
122 | | - | |
123 | | - | |
124 | | - | |
125 | | - | |
126 | | - | |
127 | | - | |
128 | | - | |
129 | | - | |
130 | | - | |
131 | | - | |
132 | | - | |
133 | | - | |
134 | | - | |
135 | | - | |
136 | | - | |
137 | | - | |
138 | | - | |
139 | | - | |
140 | | - | |
141 | | - | |
142 | 105 | | |
143 | 106 | | |
144 | 107 | | |
145 | 108 | | |
146 | | - | |
147 | | - | |
| 109 | + | |
148 | 110 | | |
149 | 111 | | |
150 | 112 | | |
151 | 113 | | |
152 | 114 | | |
153 | | - | |
154 | 115 | | |
155 | 116 | | |
156 | 117 | | |
157 | 118 | | |
158 | 119 | | |
159 | 120 | | |
160 | 121 | | |
161 | | - | |
162 | | - | |
163 | | - | |
164 | | - | |
165 | 122 | | |
166 | 123 | | |
167 | 124 | | |
168 | 125 | | |
169 | | - | |
170 | | - | |
| 126 | + | |
171 | 127 | | |
172 | 128 | | |
173 | 129 | | |
174 | 130 | | |
175 | 131 | | |
176 | | - | |
177 | 132 | | |
178 | 133 | | |
179 | 134 | | |
180 | 135 | | |
181 | 136 | | |
182 | 137 | | |
183 | 138 | | |
184 | | - | |
185 | | - | |
186 | | - | |
187 | | - | |
188 | 139 | | |
189 | 140 | | |
190 | 141 | | |
| |||
252 | 203 | | |
253 | 204 | | |
254 | 205 | | |
255 | | - | |
256 | | - | |
| 206 | + | |
257 | 207 | | |
258 | 208 | | |
259 | 209 | | |
260 | 210 | | |
261 | 211 | | |
262 | | - | |
263 | 212 | | |
264 | 213 | | |
265 | 214 | | |
266 | 215 | | |
267 | 216 | | |
268 | | - | |
269 | 217 | | |
270 | 218 | | |
271 | 219 | | |
272 | 220 | | |
273 | 221 | | |
274 | | - | |
275 | | - | |
276 | | - | |
277 | | - | |
278 | 222 | | |
279 | 223 | | |
280 | 224 | | |
| |||
293 | 237 | | |
294 | 238 | | |
295 | 239 | | |
296 | | - | |
297 | | - | |
| 240 | + | |
298 | 241 | | |
299 | 242 | | |
300 | 243 | | |
301 | 244 | | |
302 | 245 | | |
303 | | - | |
304 | 246 | | |
305 | 247 | | |
306 | 248 | | |
307 | 249 | | |
308 | 250 | | |
309 | 251 | | |
310 | 252 | | |
311 | | - | |
312 | | - | |
313 | | - | |
314 | | - | |
315 | 253 | | |
316 | 254 | | |
317 | 255 | | |
| |||
360 | 298 | | |
361 | 299 | | |
362 | 300 | | |
363 | | - | |
| 301 | + | |
364 | 302 | | |
365 | 303 | | |
366 | 304 | | |
367 | | - | |
368 | 305 | | |
369 | 306 | | |
370 | 307 | | |
371 | 308 | | |
372 | 309 | | |
373 | 310 | | |
374 | 311 | | |
375 | | - | |
376 | | - | |
377 | | - | |
378 | 312 | | |
379 | 313 | | |
380 | 314 | | |
| |||
501 | 435 | | |
502 | 436 | | |
503 | 437 | | |
504 | | - | |
505 | 438 | | |
506 | 439 | | |
507 | 440 | | |
| |||
0 commit comments