Pith. sign in

REVIEW 1 cited by

What Distributed Systems Say: A Study of Seven Spark Application Logs

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2108.08395 v1 pith:KGK6GGE6 submitted 2021-08-18 cs.DC cs.SE

classification cs.DCcs.SE
keywords logsdistributedsystemsexecutioncostinformationperformanceresearch
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Execution logs are a crucial medium as they record runtime information of software systems. Although extensive logs are helpful to provide valuable details to identify the root cause in postmortem analysis in case of a failure, this may also incur performance overhead and storage cost. Therefore, in this research, we present the result of our experimental study on seven Spark benchmarks to illustrate the impact of different logging verbosity levels on the execution time and storage cost of distributed software systems. We also evaluate the log effectiveness and the information gain values, and study the changes in performance and the generated logs for each benchmark with various types of distributed system failures. Our research draws insightful findings for developers and practitioners on how to set up and utilize their distributed systems to benefit from the execution logs.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. PDLogger: Automated Logging Framework for Practical Software Development

    cs.SE 2025-07 conditional novelty 6.0 of 10

    PDLogger generates complete multi-log statements for Java methods by combining block-aware LLM prompts, backward slicing, and refinement, outperforming prior single-log tools.

Pith tools