Barnabas:Thank you. Welcome, everybody, to ACDT number 60. We seem to have a very light schedule for today, but let's jump straight into it.
Transcript
Barnabas:So, Fusaka-related topics, last week we had, supporting BPO2, and, Hoodi Fusaka activation, fork activation.
Barnabas:Most things went smoothly, except, Prism, found a bulb. I will get, Manu to talk about that in a little bit.
Barnabas:And, for the rest of this week, we are expecting BP01 to go live on Hoodi, and hopefully that will be a smooth transition as well.
Barnabas:Manu, would you like to take the floor?
Manu:So let me pass the… So, HackMD. So, yeah, briefly, I just read the TRDR.
Manu:So, we notized two things, with Prism.
Manu:The first one is starting at Houdi, Fusaka and Houdi.
Manu:We noticed a few attester nodes on the network, which are struggling. By struggling, I'm… Talking about…
Manu:Producing attestation where target.epoch minus source.epoch is higher strictly than 2.
Manu:There's not maybe Prism, or maybe not, I don't know yet.
Manu:And, yes, and so when, this is, this is the first issue, and when, we have some node storing like that.
Manu:in some cases, PRISM, when receiving attestation from those notes, may, in some cases, reject attestation, and then don't score to the peer…
Manu:who broadcast it, who, yeah, who gossiped the attestation and eventually disconnects the PR.
Manu:And at the end, yes, we see that we mainly lose a lot of lighter spills, and…
Manu:We gain a lot of, present peers.
Manu:Yeah, so this is the TLDR, if you want to read in more details, there is a HackMD which is linked in the chat.
Manu:And we are working on a fix.
Manu:Hopefully today, or… Early this week.
Barnabas:Okay, great. So we were hoping to get all the claims released out by end of today.
Manu:So, I assume that might not be possible.
Barnabas:represent anymore?
Manu:No, no, no, no. Not for today, for sure. For sure, even if we, if we fix the…
Manu:click the bug today, I mean, we will need some days, a few days for soaking before releasing.
Manu:So, definitely not today.
Barnabas:Right, okay.
Barnabas:What about any other client teams? Anyone found any Fusaka-related books, in the recent days, or during Hudi?
Barnabas:Okay, and regarding, any other… yep.
Barnabas:Enrico?
Barnabas:Enrico, you raise your hand.
Enrico Del Fante (tbenr):Sorry, I was in mute.
Enrico Del Fante (tbenr):I joined late, so I don't know if it's been mentioned already, but by the end of last week, we discovered some…
Enrico Del Fante (tbenr):Bad blob sidecars.
Enrico Del Fante (tbenr):KCG proofs flow… with the wrong KCG proofs floating around in the network, and we did an analysis that has been…
Enrico Del Fante (tbenr):Like that in many… many, destinants before.
Enrico Del Fante (tbenr):So, we noticed that, because we had a bug log that was printing, that some of the website card we received would have been rejected, and then we did… we dig into that, and we found out that the proofs were wrong. So, according to my
Enrico Del Fante (tbenr):Yeah, according to my, to my latest update, it was a load star primarily sending this over the network, and apparently they're working on a fix.
Enrico Del Fante (tbenr):And, we started the minute release, and we should do… we should go out with it in the upcoming hours.
Barnabas:So was it just a partial number of blobs?
Barnabas:Or all blood… Transactions?
Barnabas:We're incorrect.
Enrico Del Fante (tbenr):The blob sidecars were wrong, so it was… they were including
Enrico Del Fante (tbenr):wrong KCG proofs, essentially. Not passing KCG validation over the gossip rule validation.
Barnabas:Did we not catch this earlier?
Barnabas:When the block became invalid.
Enrico Del Fante (tbenr):That's a good question.
Enrico Del Fante (tbenr):We've probably changed something on the logging side that become… make this more, evident.
Enrico Del Fante (tbenr):the frequency of on Houdi happening was…
Enrico Del Fante (tbenr):probably higher, but we discovered… we checked that it was also happening on Sepolia, probably on Olski too, so yeah.
Enrico Del Fante (tbenr):Don't know why.
Barnabas:What about on Fusaka Devna 3?
Enrico Del Fante (tbenr):I haven't checked there. I haven't checked there.
Barnabas:Because that would be a platform where we could do end-to-end tests, basically, and validate that if our center picks for it, then…
Barnabas:We would be able to validate it.
Enrico Del Fante (tbenr):Yeah, I don't know how to actually catch this, maybe having,
Enrico Del Fante (tbenr):A metric that tracks how many rejection happens on every subnet.
Enrico Del Fante (tbenr):Which can tell you, even in testnets.
Enrico Del Fante (tbenr):DevNets, that's there. There is something wrong sent over the network, but otherwise, everything is normally recorded as a debug log, so it's kind of hidden, so…
Enrico Del Fante (tbenr):If…
Enrico Del Fante (tbenr):The good thing has been distributed on the network anyway, you don't see that there was something wrong sent over anyway.
Enrico Del Fante (tbenr):Yeah, maybe, maybe some, some kind of metric.
Enrico Del Fante (tbenr):could help.
Enrico Del Fante (tbenr):In the future.
Barnabas:Yeah, Manu?
Manu:Yeah, I wanted to say that I also, saw, a lot of, Lodstar, peers, passing, 0.6000Z cell proof.
Manu:And, yes, I said this already on the Discord, but…
Manu:for example, for Prism, if,
Manu:PRISM does get blobs V2 from the EL, and if, for some reason, the EL gives bad proofs, then in this case, PRISM won't verify the proof, because we trust the execution layer.
Manu:And then, this proof will be, will be, you know, in, in, in,
Manu:data column sidecars, and then Prism will send data column sidecars with bad proof, and will be, you know.
Manu:And that messages will be rejected by other peers, and at the end, peers will reject… will, don't score and eventually, disconnect,
Manu:For example, Pierre, who, who, who did the… gets blocked V2 because of, potentially, bad…
Manu:from the, from the ear.
Enrico Del Fante (tbenr):Yeah, and also Teku, and probably most of other kinds will do that. So…
Enrico Del Fante (tbenr):If the source of this problem was the EL, maybe a test on the engine API,
Enrico Del Fante (tbenr):on every CL… EL client could have triggered this, detected this.
Barnabas:Yeah, Nicole?
nflaig:Yeah, so I think Matt is not here, so I can give a quick update what we found so far. So there is not really an evidence that it's from the EL yet.
nflaig:We had a bug, that we are fixing, where basically we would, call get blob32 or reconstruct cells, and then we import the block, and then…
nflaig:What we do internally, we clean up the block input, which basically tracks the columns and the block, and then when we would receive another column for the block over Gossip, we would restart the whole process, because we internally, the code was already pruned.
nflaig:So we would call get blob32 again for that data, even though the block is already…
nflaig:Fully there and, imported.
nflaig:And we think the zero boost might be some internal buffer that gets overwritten due to that, while we are still…
nflaig:Flushing the data to gossip.
nflaig:And maybe regarding the, why we didn't see this on the DevNet, so there was a pretty major refactoring we did about a month ago, so this code wasn't really running for that long on the DevNet also.
Barnabas:Yeah, mono?
Manu:Sorry, I just forget to lower my hand.
Barnabas:Have you noticed any of these zero proofs, floating around that were not published by Lodestar?
Manu:Yeah, mainly by those stories.
Manu:But not only.
Manu:But mainly.
Barnabas:What does that mean?
Manu:I mean… Which other…
Barnabas:Which other client have you detected?
Manu:Yeah, I saw at least one Sprism, at least… exactly one Sprism, I saw exactly one Sprism.
Manu:And that's why, because of that, I assume… assume,
Manu:a bad EL proof coming from the EL may be the cause.
Manu:But it's, yeah, it's very majority of time, it's lost our, and…
Manu:And sometimes it's not Lustar, sometimes it is other clients, including Prism. But… Yes, let's say 0.
Manu:Between 0 and 1% of the time, it's not close to.
Barnabas:Okay, do we feel like this is a critical problem going forward?
Manu:I don't think so, because in this case, just the…
Manu:The, the, the sidecar is just rejected.
Manu:And that's all.
Manu:And so the 40 peer may be,
Manu:Don't scroll… is don't scroll and may be disconnected, but the sidecars, the 40 sidecars, are not gossiped over the network by the first player.
Barnabas:Right.
Barnabas:Do we have any other Fusaka-related topics?
Barnabas:In case not, then maybe we can move on to the AI gospel testing.
Barnabas:Anyone from NetherMind or the testing team, Ari, could you give us an update how everything is going?
Kamil Chodoła:I can give an anomaly to that. So, for now, we are focusing on stabilizing the entire environment, that's why last week, we decided to switch to 100 megas blocks only, and this is better right now, results are much more stable, and
Kamil Chodoła:The feedback loop is faster, that's a good thing.
Kamil Chodoła:Other than that, working on adding newest version of EST compute scenarios, but having some issues with generated Genesis files, working with Louis on that.
Kamil Chodoła:And in the meantime, we are working together with Marius…
Kamil Chodoła:on some repricing branches and repricing machine, where we're only testing the… and very… grasping the inputs for potential repricings for Glamster now.
Kamil Chodoła:And from stateful scenarios point of view, here I need to refresh the machine, which is testing SAN and other stateful tests on top of LoadNet, because there was some issue out there, and it is down for now, but I need to revive it.
Kamil Chodoła:And in the meantime, everything,
Kamil Chodoła:is progressing, I would say, in proper direction. We need to improve our metrics collection to have a better input for repricings moving forward.
Parithosh Jayanthi:Also, to note that clients starting this week will be releasing with 60 million as the default, so as and when the network starts updating, we should see the gas limit go up.
Parithosh Jayanthi:Or at least starts being booted up.
Kamil Chodoła:I see already some blocks on 35+, again, so…
Ben Adams:We may… we may have an issue, because…
Ben Adams:I think the gas limit was voted up last time, rather than using the defaults, so…
Ben Adams:It may be more resistant to going up if everybody's manually set their value.
Ben Adams:We might need to reach out.
Ben Adams:For the community.
Kamil Chodoła:And what will happen, probably, will be that we will… I'll update at once on…
Parithosh Jayanthi:Outlook, right?
Parithosh Jayanthi:Also, the… yeah, the good thing is there's a hard focus, so… worst case, we'll hit the gas limit up a bit then.
Ben Adams:Yeah, but if they've used flags to set it to 45, then… Little stat, 45.
Barnabas:I think most users will be using, the default flags.
Parithosh Jayanthi:Yeah, but it is worth reaching out. We can do a round of that once the releases are out.
Barnabas:Yeah.
Barnabas:Okay, so is there anything else for estimate testing?
Barnabas:But then, let's, get into grump serum testing.
Barnabas:Stefan, would you have an update for us?
Stefan Starflinger:So the definite, is pretty ready. Nethermind, and Russ have signaled that they're ready with the last changes from the call on about.
Stefan Starflinger:But Geth, and PESO, I think they haven't signaled yet, and I think we might have also a testing update.
Stefan Starflinger:Do you have a… Testing update regarding the latest tests.
raxhvl:Yeah, I've posted it in the chat.
Stefan Starflinger:Okay, that sounds pretty promising. I think as soon as that's ready, we can start with the DevNet.
Jared Wasinger:Sorry, but what do you mean by signaling in this context?
Jared Wasinger:I mean…
Jared Wasinger:Like, when you say the clients have signaled that they're ready or not.
Stefan Starflinger:Oh, I…
Stefan Starflinger:in the blog access list chat, I tagged all the client teams and asked to give, like, a thumbs up when they're ready.
Jared Wasinger:Oh, okay, gotcha, yeah. I'll do that, I think Geth should… Geth should be ready, yeah.
Stefan Starflinger:Yeah, so that would be nice if, when you're ready, also when Biso's ready, and then I will, start the, DevNet.
Stefan Starflinger:I think that's it from my side.
Barnabas:Yeah, Mark?
Marc:Oh yeah, I just had a quick question about these, test results.
Marc:So it's from… are those, test fixtures up to date? So I know we agreed to make some, kind of, change just before the DevNet,
Marc:And I'm not sure if that's included or not in those tests.
felipe:Rahul, I saw you left and came back. Did you catch that question?
raxhvl:No, no, I just lost it. Could you repeat that?
Marc:Yeah, I was just asking if those, tests, 1.3.0, is that up to date? Because, yeah, the Coinbase change, is actually.
raxhvl:No, I think… Yeah, there is a new release coming up.
Marc:Okay.
raxhvl:That'll be likely today or tomorrow.
raxhvl:That includes close to, I think, 25 tests.
raxhvl:Yeah, so that should cover everything.
Marc:Okay, great. Thank you.
felipe:Yeah, and the updates to the Coinbase are also there too, so it does update some of the older tests, according to the breakout.
felipe:Session conversations.
draganrakita:Are those 100% passing on that new test suit, or on old one?
raxhvl:The results are from the previous test. This does not include the Coinbase test, so we'll… we'll update the results today, once we have a new release.
Barnabas:Okay, great. Is there anything else regarding… Doctor back to this testimon?
Stefan Starflinger:I think that sums it up.
Barnabas:Okay, anyone would have any updates regarding EPBS?
Mario Vega:Hey, so, I don't have that many updates, but, Justin did ping me before the meeting that he won't be able to join. Basically, the only updates is that there are two new releases on the consistent specs. One is 1.6.0, and the other is 1.6.0 beta number 2.
Mario Vega:So, that's… that's basically it. Just… just please give it a look. I, I see that there's a comprehensive,
Mario Vega:readme, at least in the 1.6.0 beta 2. So yes, I think that should give you more context. But yeah, more than that, I'm not… I'm not sure.
Barnabas:Yeah, I also haven't heard any update from buying teams, signaling that they would be ready for DevNet Zero, so…
Barnabas:I don't think we can do, APB as a net0 before NetConnect, but maybe…
Barnabas:all DevNet Zero could actually happen sometime this week, and then we would have something, running throughout DevConnect, and then we should target for, APBS DevNet late November, early December.
Barnabas:Any other, questions or updates regarding Glamster then?
Barnabas:Maybe then we can talk about, the mainnet client releases. We heard from Prism already that they would not be ready, for today.
Barnabas:But, I would like to hear from every single client team if they could make it.
Kamil Chodoła:So, for NaturMind, we are working on release right now, but we are facing some unexpected regression around sync,
Kamil Chodoła:So… Worst case scenario will release today, minimize the version.
Kamil Chodoła:And we'll have hotfix probably in the coming days.
Andrew Ashikhmin:For Aragon, we've released 3.2.2 today, which has Fusaka on mainnet.
Barnabas:Can you guys also confirm everybody, set the gas limit to 60 million by default?
Andrew Ashikhmin:Yup.
Andrew Ashikhmin:It was said in the previous patch release.
Andrew Ashikhmin:So, yeah, it's sad.
Barnabas:Okay, great. And, any CL teams?
Barnabas:If you're reading the chat, I see that, the expiration will not release, and…
Barnabas:Taku is in progress, I'm gonna start his working RNAs as well.
Barnabas:Oh, I think it looks like, we're not gonna have a complete list of releases by the end of today.
Barnabas:We should really try to do a deadline by…
Barnabas:I would say Wednesday this week.
Barnabas:And if we cannot meet that deadline, then, we might actually need to consider rescheduling main network.
Barnabas:Just in… in case to have that, for today in between.
Barnabas:releases, but… Yeah, I really don't want to have that.
Barnabas:Yeah, is the 5th of, 5th of November as a final deadline would make sense, and then I think we could have the blog post out by Thursday, maybe by ECD.
Barnabas:I haven't talked with Alex, when we wanted to check out the blog post, but I think, this week would be very, very good.
Enrico Del Fante (tbenr):Point is that we sh… we don't want to release if, for… by any chance, there is some… there is still a…
Enrico Del Fante (tbenr):As a condition in which we could postpone.
Enrico Del Fante (tbenr):So, it could be tricky, then, to… Whatever colder it is.
Enrico Del Fante (tbenr):We could, but there might be a noise.
Barnabas:Yeah, I think if we can have all the clients raised by the 5th, we really shouldn't have a problem, still forcing, maybe not on the 3rd of December.
Barnabas:I'm just a bit worried that if we do slide it, for, like, next week, there are gonna be further delays, yeah, due to DevConnect.
Barnabas:And that could actually lead to potentially, causing some issues down the line.
Barnabas:Because we did want to leave at least one month between now.
Barnabas:Reason, Minnet.
Barnabas:I think the main, the main question here is,
Barnabas:If PRISM would be, if PRISM thinks that they would be ready by Wednesday.
Manu:Yeah, so, in the best case, we…
Manu:In the best case, yes, we… we find the… we fix the bug today.
Manu:Which is a third.
Manu:And we need a few days for, for soaking.
Manu:So yes, fifths will be the really best, best, best case, in my opinion, for a release date.
Manu:It's more, reasonable to expect a release this week, but maybe not on Wednesday.
Manu:Yep.
Manu:Yeah, yeah, yeah, so, I mean, yes, so in the best case, release candidate on 5th. If we fix a bug today, we can have a release candidate on 5th.
Manu:Yes, but maybe not a release on this day.
Manu:Yep.
Barnabas:Yeah, maybe Lighthouse can also comment?
Barnabas:Not sure if anyone from that house is here.
Barnabas:I'm quite sure you find anyone.
Barnabas:And the call from Nathan.
Barnabas:Yep, met you.
Matthew Keil:So, we identified a bug as well, that didn't show up until we got to the larger network. We've figured out what the issue is.
Matthew Keil:And we're in the process of also soaking a fix.
Matthew Keil:And talking about it actively. So we should be able to get the release out, but that is also kind of a…
Matthew Keil:by the 5th is our goal, but just wanted to put it out in the world that it's a best-case scenario.
Barnabas:Thank you.
Barnabas:Yeah, I think we should, stick to the original timeline of the 3rd of December, let's push out the releases, and
Barnabas:we need to re-evaluate by Occo Devs on Thursday if we really don't have all the
Barnabas:all the major releases by, all core devs, then, we might need to discuss an alternative deadline.
Barnabas:Or, main net.
Barnabas:But I think we should stick to the, urgent schedule for now, because, yeah, the 30-day is,
Barnabas:It's almost there, with, having already settled by the 5th.
Barnabas:But if, by Thursday, all coordinates, we cannot,
Barnabas:we cannot have the releases, then… then I think an alternative proposal will have to come up.
Barnabas:Does that sound reasonable?
Barnabas:For, everyone?
Barnabas:Okay, great. And I just got a confirmation from Alex that we're gonna be targeting the blog post also by Thursday.
Barnabas:So, yeah, just please keep working on your releases.
Barnabas:Okay, there's one more topic that Mario wanted to bring up, the testing complexity assessment checklist.
Barnabas:Could you please, bring it up, Mario?
Barnabas:If you're here.
Mario Vega:Yeah, of course. Yeah, it's very, it's very quick. So, we are gathering information on, the…
Mario Vega:proposed for inclusion EIPs for Amsterdam, and we've seen that there's a ton of them, and so, we have a tracker for this, I just showed you the link. We're gonna use a checklist, basically, to follow the,
Mario Vega:to try to determine how the testing complexity for a given EIP is, like, either high or low. This is only for the execution layer at the moment.
Mario Vega:But, in any case, if you want to jump in and chime in into this issue, please do so in regards of any EIPs that you think we should prioritize.
Mario Vega:Because you see more impact of this EVM EIP, just please go into the issue and comment on there, and we'll try to prioritize,
Mario Vega:to assess the complexity of the testing of this EVM EIP, so we can move it forward, and maybe even start with the specification implementation, and also the testing implementation.
Mario Vega:But yeah, that's basically it.
Barnabas:This is great, Mario, thank you. Would you be open to also include the CL EIPs in here?
Barnabas:I know that they would be targeting different kind of tests, but… We only have a,
Barnabas:very few, I think maybe 3 CL-specific EIPs in Amsterdam.
Mario Vega:Yeah, absolutely. I mean, if you have comments on the…
Mario Vega:on the CL EIPs that you want, that you want, that you think we should prioritize, just… you just feel free to leave them here. We'll try to redirect this to the proper people to… to… for them to… to start implementing or, assessing the complexity of an EIP, yeah.
Barnabas:Yep.
Barnabas:So, would you expect, that each team goes through all the IPs, and assigns someone to it, or…
Mario Vega:So, yeah, that's it, that's the question, right? So there's too many EIPs, in my opinion. So what I'm asking here is that if we can, like.
Mario Vega:get a sentiment from the rest of the core devs for Glamstagram EIPs, just to see which ones we should prioritize on… on assessing.
Mario Vega:based on their feeling on which one will have the better impact in the EVM,
Mario Vega:I think, I think that's… that's what we should, like, lead with, with those EIPs, yeah.
lightclient:I feel like the problem is that we have 10 EIPs that are just focused on pricing-related concerns.
Ansgar Dietrichs:Matt, can you clarify how is this a problem in this regard specifically?
lightclient:I mean, we want someone to, like, deeply look at all these EIPs, and we also want to try and find the things that are impactful, but if we're just going… you know, if we're going to do the pricing, which is seemingly, like, highest priority, I don't even know if we have the bandwidth to also be doing
lightclient:that many impactful things to the EVM on top of that, that are not related to pricing.
Ansgar Dietrichs:Right, but that seems more like a general folk scoping kind of
Ansgar Dietrichs:Argument and discussion, whereas for, like, specifically the testing impact assessment.
Ansgar Dietrichs:I mean, yeah, I would focus on basically figuring out what are the first batch of, like, most important, highest impact ones that we should try to get a feeling for first.
Ansgar Dietrichs:And that probably includes some repricing, maybe includes some non-repricing ones.
lightclient:It just feels like a lot to me. I feel like we should have…
lightclient:some clear prioritization of the EIPs before we just… Analyze all of them.
lightclient:But if people feel like we have the bandwidth to do it, then we can do it.
Mario Vega:You know, I completely agree with you, Lagland. Yeah, that's what I… I feel like we're overwhelmed at the moment with the amount of EIPs that we have to analyze.
Łukasz Rozmej:So, what I wanted to get from.
Mario Vega:the rest of the core labs, is there's… if there's, like, a clear sign of which ones we should prioritize.
Mario Vega:Yeah, I completely agree, this is too much.
Łukasz Rozmej:Nevermind team went through, I think, all the APs, maybe there were some newly…
Łukasz Rozmej:We went through all this, we find, and we can share some of our views. We… I think it's not yet, like, published so far, but we can at least, if we want, give you, like.
Barnabas:It's been pretty hard to hear you in the past.
Łukasz Rozmej:What?
Łukasz Rozmej:Okay.
Barnabas:Nope.
Barnabas:Maybe you can give a… just leave some, text in the chat?
Barnabas:Because your audio is cutting out.
Łukasz Rozmej:I'm driving.
Barnabas:Okay.
Marc:Yeah, he was just saying the team's gone through all of the different EIPs, and, we're in the process of writing something up that we can share soon.
Barnabas:Yeah, I think it would be good if some bigger teams would be able to, like, give the other teams a heads up of, like, which are the EIPs that they would consider kicking out right away, decorate as fast as possible, so that other teams wouldn't need to
Barnabas:basically chew through those EIPs, and I think that would be very, very good.
Barnabas:Could we have the Netherland list open, or, like, publicly available for everyone, and then maybe we can already start kicking
Barnabas:AIPs out on this week's, Occo Devs call.
Marc:Yeah, we can post it somewhere soon.
Barnabas:That would be good. Thank you.
Barnabas:Anyone else have any other topic that they would like to discuss?
lightclient:I think just last thing on this… For the testing team?
lightclient:I think the highest priority is the repricing EAPs.
lightclient:So, if you're still waiting for more signal, I think that's…
lightclient:The clearest signal to me is that we need to look at these and figure out
lightclient:What makes sense, where the complexities are gonna be, what the interplay between them is going to be, and then when clients start releasing their preferences, we can start looking at the non…
lightclient:Free pricing related stuff.
Barnabas:Yep. Charger?
Fredrik:Yeah, this is unrelated to… to that, but,
Fredrik:Yeah, as we're moving towards the mainnetwork, we are… we also have the mainnet upgrade and incident response team plan, which Alex has been working on.
Fredrik:You can find it here.
Fredrik:Basically, it will be the same as we did for
Fredrik:the idea of this is that we do it the same way as we do with Pectra, where each of the client teams sound
Fredrik:Shared roles. Teams have, basically coordinators assigned to,
Fredrik:As points of contacts, so,
Fredrik:It's probably a good idea for client teams to at least start thinking about
Fredrik:Who should be the primary coordinator? Who should be the backup?
Fredrik:Coordinator, etc, and yeah, it's something that we're gonna have to be… Doing in the coming weeks.
Barnabas:Yeah, could you guys please make a PR to this,
Barnabas:more than fine if you feel like you could be your client team's primary or backup coordinator, and you can start merging in those PRs.
Barnabas:Or, yeah, possibly just reach out to Alex. I'm not sure if there's an open PR about this already.
Fredrik:I don't think there is… he's… I don't think he's opened a PR yet.
Barnabas:Yeah, because I just saw that this was at work.
Fredrik:Yep.
Barnabas:Okay, so I think we should merge this, into the upstream repo as soon as possible, and then, client teams can make a PR to that.
Barnabas:Thanks for bringing it up.
Barnabas:Okay, is there anything else?
Barnabas:Okay, Slat, good luck with all the releases, and well, hopefully everyone
Barnabas:We'll be ready by, Wednesday or Thursday this week.
Barnabas:And see you all on Thursday.
Manu:Video, thank you.
Stefan Starflinger:Thank you.
Andrew Ashikhmin:My buddy.
Mario Vega:Thank you, goodbye.
Chat Logs
00:04:31
Manu:https://hackmd.io/JLER6rPgTP6Uk0wd0yCpPA?view
00:07:10
nflaig:we are working on the lodestar zero proofs bug
00:10:13
Barnabas:sorry baby in the background going wild.
00:12:25
Barnabas:Anyone from lodestar could comment on this bug?
00:15:48
Enrico Del Fante (tbenr):Yes not critical for us too
00:19:58
raxhvl:Latest results for BAL test v1.3.0
---
Overall - 98%
-----
* Besu - 100%
* Reth - 100%
* Geth - 99%
* Nethermind - 91%
00:21:54
draganrakita:Do you mean coinbase change?
00:21:59
draganrakita:It should be included
00:23:07
Toni Wahrstätter:Btw, EIP-7928 breakout happening on wednesday, 2pm UTC.
00:24:28
Mario Vega:https://github.com/ethereum/consensus-specs/releases/tag/v1.6.0-beta.2
https://github.com/ethereum/consensus-specs/releases/tag/v1.6.0
00:25:41
draganrakita:We are planing Reth release for Wednesday.
00:25:50
Enrico Del Fante (tbenr):Teku release in progress. Should be out n a few hours
00:25:54
Marius van der Wijden:Geth is working on a release, either today or tomorrow
00:26:12
Kamil Chodoła:Nethermind Yes
00:26:31
Enrico Del Fante (tbenr):60M default for teku already in past release too
00:26:52
Phil Ngo:Lodestar is working on a release pending this fix with the zero proofs. We could release but it would be incomplete. We’ll take a look to see if we can get it fixed by today
00:27:06
Fredrik:Can we discuss the mainnet plan for 2 min after the release topic?
00:27:12
Kamil Chodoła:Is there any deadline for releases to have input for blogpost etc? As worst-case may be we will release tomorrow.
00:27:28
Fredrik:(Upgrade & incident response plan)
00:27:48
Kamil Chodoła:So deadline 5th
00:28:20
Kamil Chodoła:OK for Neth - gives us a bit more time to make better version
00:29:51
James:I don’t think we would make Wednesday. We wouldn’t have any time to soak the release
00:29:53
Enrico Del Fante (tbenr):Is it reasonable 5th for prysm?
00:30:38
Kamil Chodoła:Release candidate can be 5th for Prysm maybe?
00:30:40
Enrico Del Fante (tbenr):What about LH?
00:31:17
James:Replying to "Is it reasonable 5th…"
I mean under best case maybe but it’s going to be really hard I don’t think it’s reasonable based on our release process
00:31:43
Manu:Replying to "Is it reasonable 5th..."
5th release candidate, not release for sure
00:33:51
Marius van der Wijden:Anything we can help clients with wrt. releasing?
00:34:18
Barnabas:Replying to "Anything we can help..."
pushing buttons 😄
00:34:21
Mario Vega:https://github.com/ethsteel/pm/issues/7
00:35:02
Raúl Kripalani:Same, pls ping me on TG if the networking team can help in any way (reviews, testing, impl, etc.)
00:35:45
Ansgar Dietrichs:is the idea to go though all of them? or identify the highest impact ones and only assess those?
00:36:02
spencer-tb:Replying to "is the idea to go th..."
All of them I believe!
00:36:37
Barnabas:Even EIPs besu/erigon/reth
Odd EIPs geth/nethermind/nimbusel
00:36:43
Ansgar Dietrichs:we might have a first batch of decisions this week on acde as well, with some first DFIs
00:36:47
wolovim:Forkcast rank page is back up, in case helpful for client team scoping preferences: https://forkcast.org/rank
00:37:51
Barnabas:@lightclient sounds like a skill issue 😂
00:38:53
Lumi | Offchain Labs:+1 to @lightclient, we are overwhelmed from OCL side on what to prioritize for review
00:39:14
Marius van der Wijden:I think its easiest to talk about what to kick/deprioritize quickly
00:40:16
Mario Vega:Replying to "I think its easiest ..."
There’s some that are really undespec’d, we should start with kicking those out
00:41:38
Ansgar Dietrichs:within repricings, Maria also posted a document on bundling options for repricings
so the core EIPs within that document would be the highest priority from the repricings
00:41:56
Fredrik:https://github.com/ralexstokes/pm/blob/fusaka-pm-docs/Fusaka/fusaka-mainnet-plan.md
00:42:59
Lumi | Offchain Labs:Replying to "within repricings, M..."
Could you link?
00:43:52
Ansgar Dietrichs:Replying to "within repricings, M..."
https://notes.ethereum.org/@misilva/SkkvIsxk-g
Summary
9 highlights
· 2 decisions · 5 action itemsExperimental
Summary
9 highlights · 2 decisions · 5 action itemsExperimentalfork status and schedule
- BPO2 and Holesky Fusaka activation completed successfully; BP01 expected live later this week00:03:46
critical infrastructure
client updates
testing progress
Decisions
Action Items
- Prysm and Lodestar teams: Fix and release Prysm attestation bug and Lodestar KZG proof bug00:06:05
- All client teams: Release mainnet clients with Fusaka support and 60M gas limit by November 5th00:27:02
- Client teams and Stefan: Signal readiness and launch Glamsterdam devnet-0 with updated test suite00:21:00
- Testing team: Prioritize repricing EIPs for testing complexity assessment00:41:01
- All client teams: Assign coordinators and submit PRs to incident response plan00:42:55