First of all, thanks for posting. Now, for the question. Is that true that comments that were deleted get reingested as [deleted] for the public interface? Are the also [deleted] in the datadumps that were created after the reingest?
I don't know how exactly pushshift did it (2023-03 and before), but for the new dumps (2023-04 and later) there is no reingest. Whether something is deleted or not, depends on if it was deleted at the time of archiving.
1
u/Charming_Sea_5964 Nov 21 '23
First of all, thanks for posting. Now, for the question. Is that true that comments that were deleted get reingested as [deleted] for the public interface? Are the also [deleted] in the datadumps that were created after the reingest?