The prime minister's decision to appear on the Bush Deep podcast last month has become a game of whack-a-mole for the government. When it was originally published, Albanese copped it for remarks he made about Kylie Minogue. He swiftly apologised for that.
But after a former Japanese ambassador, Shingo Yamagami (who is no fan of the Labor government as my colleague Stephen Dziedzic reported), claimed the joke was disrespectful, the podcast returned to the headlines.
Albanese could have done the same thing he did last time, swiftly conceding his mistake before moving on but he didn't.
Instead, a diplomatic note in which Japan said it saw no ill-intent in the remarks found its way into the media. The Coalition referred the apparent leak to the federal police as it took up the issue in parliament.
As David Speers wrote, the full-throated pursuit of the saga by the Coalition might, in time, prove to be the right choice. Slowly chipping away at the paint of Albanese's character, much like Labor did to Scott Morrison.
Albanese is fortunate that none of the women involved, Sanae Takaichi, Kylie Minogue, nor his wife Jodie, have publicly commented on the jokes he made about them.
Getting grilled at press conferences isn't the only common ground Albanese and Taylor have shared this week. The pair met several times behind the scenes in a bid to hash out deals on gambling advertising, the National Disability Insurance Scheme and the news media bargaining incentive.
The government wants all three bills ticked off before parliament rises next week. Albanese told the caucus he expected the NDIS overhaul to pass with the Coalition's support.
He was also projecting confidence that the government's planned changes to gambling advertising would pass once an agreement was reached on winding back inducements to entice people to punt.
A targeted crackdown on inducements offered to high rollers and a simplified option to curb ads on streaming services may be where this lands, as Clare Armstrong reported this week.
Crossbench MPs conceded they had "lost the battle" on tougher gambling advertising restrictions, as some within the Coalition began calling for an automatic review to be baked into the legislation.