Workflow - Reformulating Suggesting Modifications

Are the commentators of suggested modifications allowed to suggest reformulations of the original formulations?

As the members of the community comment on suggested modifications, new formulations are sometimes offered by the commentators. These reformulations are sometimes deemed advantageous by the community and can lead to a communal consensus. The question is whether such reformulations are allowed in the scientonomic workflow and, if so, how they should be handled in practice, including how, if at all, these reformulations should be published and who should get the authorship of these reformulations.

In the scientonomic context, this question was first formulated by Hakob Barseghyan and Jamie Shaw in 2019. The question is currently accepted as a legitimate topic for discussion by Scientonomy community.

In Scientonomy, the accepted answers to the question can be summarized as follows:

• The commentators of suggested modifications are allowed to suggest reformulations of the original formulations in the comments. By default, the new formulation should bear the original author’s name, unless the author decides to give credit to those who significantly contributed to the new reformulation.
• Scientonomic knowledge is best advanced by:

1. documenting the body of accepted communal knowledge knowledge in an online encyclopedia;
2. scrutinizing this accepted knowledge, identifying its flaws, and formulating open questions at seminars, conferences, publications, and other in-person or online formats;
3. publishing journal articles that propose modifications to our current knowledge and documenting these suggestions;
4. evaluating the suggested modifications with the goal of reaching a communal consensus and changing the respective encyclopedia pages when a verdict is reached.

Scientonomic History

Acceptance Record

Here is the complete acceptance record of this question (it includes all the instances when the question was accepted as a legitimate topic for discussion by a community):

Community	Accepted From	Acceptance Indicators	Still Accepted	Accepted Until	Rejection Indicators
Scientonomy	22 December 2019	The publication of Shaw and Barseghyan (2019) is and indication of the acceptance of the question.	Yes

All Theories

The following theories have attempted to answer this question:

Theory	Formulation	Formulated In
Allow Modification Reformulations (Shaw-Barseghyan-2019)	The commentators of suggested modifications are allowed to suggest reformulations of the original formulations in the comments. By default, the new formulation should bear the original author’s name, unless the author decides to give credit to those who significantly contributed to the new reformulation.	2019

If an answer to this question is missing, please click here to add it.

Accepted Theories

The following theories have been accepted as answers to this question:

Community	Theory	Accepted From	Accepted Until
Scientonomy	Allow Modification Reformulations (Shaw-Barseghyan-2019)	25 February 2023

Suggested Modifications

Here is a list of modifications concerning this topic:

Modification	Community	Date Suggested	Summary	Verdict	Verdict Rationale	Date Assessed
Sciento-2019-0003	Scientonomy	22 December 2019	Accept that the commentators of suggested modifications are allowed to suggest reformulations of the original formulations. Also accept that, by default, the new formulation should bear the original author’s name, unless the author decides to give credit to those who significantly contributed to the new reformulation. This should be decided collegially by the author, the commentators, and the editors on a case-by-case basis.	Accepted	The decision was made during the 2023 scientonomy workshop. It was noted that the idea is compatible with other consensus systems where one is allowed to modify the proposal in order to reach consensus. The modification sparked important discussion about our iterative process. Paul Patton highlighted a potential problem with our workflow where, by the time we are discussing acceptance, the paper has already been formatted and published. He raised a question if it might be more advisable to use a two-stage process, where a paper is first posted in some preliminary form and then, following the debate on acceptance, it is reformulated as needed and the final version is considered published. Hakob Barseghyan responded that there always has to be a chance of commenting on something published post factum. Instead of the two-step process, he suggested allowing small alterations to modifications after the publication and publishing the commentaries to modifications in a separate article (as the community just accepted with modification 2019-0002), while leaving the original article intact. Greg Rupik also suggested the potential for a special designation for a tweaked modification identifier (e.g. 2019-0003a instead of 2019-0003) to make it more apparent which modifications were reformulated. Barseghyan responded that the wiki is well-suited to make reformulations apparent (most specifically, in the Preamble and Verdict sections) without the need to multiply modifications. He also emphasized that this modification pertains to smaller reformulations and not to significant changes to the content, making some concerns about the modification less immediately relevant. Barseghyan also addressed the question posted prior to the workshop by Ameer Sarwar: when other authors cite a modification that has been altered, what exactly should they cite? Barseghyan suggested that, since both the original modification and the altered one will be published, one can cite both. The modification was accepted unanimously.	25 February 2023

Current View

In Scientonomy, the accepted answers to the question are Allow Modification Reformulations (Shaw-Barseghyan-2019) and Scientonomic Workflow (Barseghyan et al.-2016).

Allow Modification Reformulations (Shaw-Barseghyan-2019) states: "The commentators of suggested modifications are allowed to suggest reformulations of the original formulations in the comments. By default, the new formulation should bear the original author’s name, unless the author decides to give credit to those who significantly contributed to the new reformulation."

By allowing the discussants to suggest alternative formulations in their comments, the workflow incentivizes commenting and aids consensus building. It often happens that the discussants agree that a little tweak in the original formulation would solve the problem. This can help speed up the advancement of our communal knowledge. In contrast, when the discussants are not permitted to reformulate the original formulations, the discussants have no other choice than to write a whole new paper arguing for what is otherwise a little tweak to the original formulation. Not only is this wasteful, but it also creates a bottleneck where a consensus formation is postponed due to bureaucratic restrictions. Thus, it is important to remove this bottleneck and allow the participants to alter original formulations. If a discussion yielded a new formulation, any such formulation should be clearly stated and added to the respective suggested modification, possibly under a separate heading (e.g. by distinguishing “Original Suggestion” from “Final Suggestion”). By default, the new formulation should bear the name of the author(s) of the original suggested modification, unless the original author(s) decides to give credit to those who significantly contributed to the reformulation. This should be decided collegially by the author, the commentators, and the editors on a case-by-case basis.

Scientonomic Workflow

Scientonomic Workflow (Barseghyan et al.-2016) states: "Scientonomic knowledge is best advanced by:

1. documenting the body of accepted communal knowledge in an online encyclopedia;
2. scrutinizing this accepted knowledge, identifying its flaws, and formulating open questions at seminars, conferences, publications, and other in-person or online formats;
3. publishing journal articles that propose modifications to our current knowledge and documenting these suggestions;
4. evaluating the suggested modifications with the goal of reaching a communal consensus and changing the respective encyclopedia pages when a verdict is reached."
   
   The key stages of the workflow are:

• Pose Questions: The goal of this stage is to scrutinize the current state of the scientonomic theory and our knowledge of scientific change and identify as many open questions as possible. The annual seminar on scientonomy hosted by the University of Toronto's Institute for the History and Philosophy of Science and Technology is currently the main venue facilitating this stage of the workflow.
• Suggest Modifications: The goal of this stage is to advance our knowledge of scientific change by proposing modifications to our current body of knowledge. These suggested modifications are published and properly documented. These modifications are currently published in the Journal of Scientonomy but, in principle, they can be published in any journal which makes use of the scientonomic mechanism of modifications. Once a modification is published, this encyclopedia documents that suggestions and invites experts to review it.
• Evaluate Modifications: The goal of this stage is to assess the suggested modifications and decide which of them are acceptable and which are not. This is done by the community of scientonomists on the respective discussion pages of this encyclopedia. If a consensus emerges, the fate of the modification is documented. If a modification causes disagreement among scientonomists, it becomes a topic of discussion during scientonomic workshops, which aim at bridging the gaps between opposing parties and arriving at consensus.
• Document Changes: The goal of this stage is to document all the changes in our communal body of knowledge. If a modification is considered acceptable by the community, then the respective articles of this encyclopedia are modified to reflect that change. If a modification is considered unacceptable, then the respective verdict is documented for that modification.

The primary role of this encyclopedia in the scientonomic workflow is to document the current state of scientonomic knowledge, trace all suggested modifications, and list open questions.

Here is an outline of the main stages of the scientonomic workflow:

This workflow gives researchers a simple way of knowing where the community stands on different topics, i.e. what theories it currently accepts, what open questions it tries to answer, what modifications have been proposed and how they have been assessed. It ensures that our communal knowledge is advanced in a piecemeal and transparent fashion:

• Piecemeal: modifications to the communal mosaic are suggested one by one, which allows for a sober critical evaluation of these suggestions by the community.
• Transparent : suggested modifications and their evaluations are properly documented, so that there is no mystery as to whether, when, or why a certain modification was or wasn't accepted.

The workflow is scalable, as it can - in principle - be implemented in other fields of digital humanities and beyond.

Related Topics

This question is a subquestion of Scientonomic Workflow.