extract characters between two commas? The 2019 Stack Overflow Developer Survey Results Are InText processing - join every two lines with commasRemove entire row in a file if first column is repeatedMerging two files, one column at a timeJoin two textfiles on 1st column keeping order and unpairable lines from 1st fileHow to print lines if two fields have identical values?Delete lines that matches a string before commahow to remove comma and strings after a comma in a file?Fastest way to sum Nth column in text fileHow to extract the first row for each entry in the first column?Compare two files and get unmatched rows from the second file based on first and second column

Families of ordered set partitions with disjoint blocks

Why is it "Tumoren" and not "Tumore"?

Extreme, unacceptable situation and I can't attend work tomorrow morning

Are there any other methods to apply to solving simultaneous equations?

How to create dashed lines/arrows in Illustrator CC

How can I fix this gap between bookcases I made?

Is this food a bread or a loaf?

What do hard-Brexiteers want with respect to the Irish border?

Idomatic way to prevent slicing?

What is this 4-propeller plane?

Why don't Unix/Linux systems traverse through directories until they find the required version of a linked library?

The difference between dialogue marks

Is domain driven design an anti-SQL pattern?

Can we apply L'Hospital's rule?

Why isn't airport relocation done gradually?

Could JWST stay at L2 "forever"?

If Wish Duplicates Simulacrum, Are Existing Duplicates Destroyed?

Poison Arrows Piercing damage reduced to 0, do you still get poisoned?

Inflated grade on resume at previous job, might former employer tell new employer?

Time travel alters history but people keep saying nothing's changed

Can I write a for loop that iterates over both collections and arrays?

A poker game description that does not feel gimmicky

Deadlock Graph and Interpretation, solution to avoid

What does "sndry explns" mean in one of the Hitchhiker's guide books?



extract characters between two commas?



The 2019 Stack Overflow Developer Survey Results Are InText processing - join every two lines with commasRemove entire row in a file if first column is repeatedMerging two files, one column at a timeJoin two textfiles on 1st column keeping order and unpairable lines from 1st fileHow to print lines if two fields have identical values?Delete lines that matches a string before commahow to remove comma and strings after a comma in a file?Fastest way to sum Nth column in text fileHow to extract the first row for each entry in the first column?Compare two files and get unmatched rows from the second file based on first and second column



.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;








4















I have a file with ~ 3 million rows, here is the first few lines of my file:



head out.txt
NA
NA
NA
NA
NA
gene85752,gene85753
gene85752,gene85753
gene85752,gene85753
gene85752,gene85753
gene85752,gene85753
gene85752,gene85753
gene85752,gene85753,gene85754
gene85752,gene85753,gene85754
gene85752,gene85753,gene85754
gene85752,gene85753,gene85754
gene85752,gene85753
gene85752,gene85753
gene85752,gene85753
gene85752,gene85753
gene85752,gene85753
gene85752,gene85753
gene85752,gene85753
gene85752,gene85753
gene85752,gene85753
gene85752
gene85752


For those rows that are separated by ",", I want to keep everything after the first comma and before the second comma.
This is my desired output:



outgood.txt
NA
NA
NA
NA
NA
gene85753
gene85753
gene85753
gene85753
gene85753
gene85753
gene85753
gene85753
gene85753
gene85753
gene85753
gene85753
gene85753
gene85753
gene85753
gene85753
gene85753
gene85753
gene85753
gene85752
gene85752









share|improve this question




























    4















    I have a file with ~ 3 million rows, here is the first few lines of my file:



    head out.txt
    NA
    NA
    NA
    NA
    NA
    gene85752,gene85753
    gene85752,gene85753
    gene85752,gene85753
    gene85752,gene85753
    gene85752,gene85753
    gene85752,gene85753
    gene85752,gene85753,gene85754
    gene85752,gene85753,gene85754
    gene85752,gene85753,gene85754
    gene85752,gene85753,gene85754
    gene85752,gene85753
    gene85752,gene85753
    gene85752,gene85753
    gene85752,gene85753
    gene85752,gene85753
    gene85752,gene85753
    gene85752,gene85753
    gene85752,gene85753
    gene85752,gene85753
    gene85752
    gene85752


    For those rows that are separated by ",", I want to keep everything after the first comma and before the second comma.
    This is my desired output:



    outgood.txt
    NA
    NA
    NA
    NA
    NA
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85753
    gene85752
    gene85752









    share|improve this question
























      4












      4








      4








      I have a file with ~ 3 million rows, here is the first few lines of my file:



      head out.txt
      NA
      NA
      NA
      NA
      NA
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753,gene85754
      gene85752,gene85753,gene85754
      gene85752,gene85753,gene85754
      gene85752,gene85753,gene85754
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752
      gene85752


      For those rows that are separated by ",", I want to keep everything after the first comma and before the second comma.
      This is my desired output:



      outgood.txt
      NA
      NA
      NA
      NA
      NA
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85752
      gene85752









      share|improve this question














      I have a file with ~ 3 million rows, here is the first few lines of my file:



      head out.txt
      NA
      NA
      NA
      NA
      NA
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753,gene85754
      gene85752,gene85753,gene85754
      gene85752,gene85753,gene85754
      gene85752,gene85753,gene85754
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752,gene85753
      gene85752
      gene85752


      For those rows that are separated by ",", I want to keep everything after the first comma and before the second comma.
      This is my desired output:



      outgood.txt
      NA
      NA
      NA
      NA
      NA
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85753
      gene85752
      gene85752






      text-processing awk






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked yesterday









      Anna1364Anna1364

      456213




      456213




















          4 Answers
          4






          active

          oldest

          votes


















          17














          Since cut prints non-delimited lines by default the following works



          cut -f2 -d, file





          share|improve this answer


















          • 1





            It's nice when someone remember the little quirks of standard tools.

            – Kusalananda
            yesterday


















          3














          awk -F, 'NF > 1 $1 = $2 print $1 ' file


          This uses awk to parse the file as lines consisting of comma-delimited fields.



          The code detects when there is more than a single field on a line, and when there is, the first field is replaced by the second field. The first field, either unmodified or modified by the conditional code, is then printed.






          share|improve this answer























          • With a big file, this would probably be faster: awk -F, 'print(NF>1 ? $2 : $1)' -- since you won't have to rewrite $0

            – glenn jackman
            yesterday











          • @glennjackman Well, the cut solution would be even faster in any case.

            – Kusalananda
            yesterday


















          1














          awk -F, 'NF == 1 print $1
          NF > 1 print $2' filename


          This will print just the first string if there is no comma, second string if there is one or more comma.






          share|improve this answer






























            0














            You can do this with Perl as follows.



            Command-line:



            $ perl -F, -pale '$_ = $F[1] // $_' out.txt


            Explanation:




            • -p will read records line-by-line AND autoprint before going in to read the next or eof.


            • -l makes IRS = ORS = "n"


            • -F, makes FS a comma.


            • -a splits each record $_ on the field separator, in our case a comma, and goes ahead and stores the fields so generated in the array @F, which is zero-indexed.


            • -e implies, what follows it is the Perl code, which shall be gets applied to each record.


            • $_ = $F[1] // $_ expression reads as follows: if the 2nd field $F[1] isn't defined, use the current record $_. And then the result of this expression is assigned to the current record $_.

            • owing to the -p switch of perl being in use, before the new record is read in, the current record is taken to stdout.

            Result:



            NA
            NA
            NA
            NA
            NA
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85753
            gene85752
            gene85752


            You may also do it with the GNU version of the sed editor as shown below:



            $ sed -ne '
            s/,/n/
            s/.*n//
            s/,/n/
            P
            ' out.txt





            share|improve this answer























              Your Answer








              StackExchange.ready(function()
              var channelOptions =
              tags: "".split(" "),
              id: "106"
              ;
              initTagRenderer("".split(" "), "".split(" "), channelOptions);

              StackExchange.using("externalEditor", function()
              // Have to fire editor after snippets, if snippets enabled
              if (StackExchange.settings.snippets.snippetsEnabled)
              StackExchange.using("snippets", function()
              createEditor();
              );

              else
              createEditor();

              );

              function createEditor()
              StackExchange.prepareEditor(
              heartbeatType: 'answer',
              autoActivateHeartbeat: false,
              convertImagesToLinks: false,
              noModals: true,
              showLowRepImageUploadWarning: true,
              reputationToPostImages: null,
              bindNavPrevention: true,
              postfix: "",
              imageUploader:
              brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
              contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
              allowUrls: true
              ,
              onDemand: true,
              discardSelector: ".discard-answer"
              ,immediatelyShowMarkdownHelp:true
              );



              );













              draft saved

              draft discarded


















              StackExchange.ready(
              function ()
              StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f511284%2fextract-characters-between-two-commas%23new-answer', 'question_page');

              );

              Post as a guest















              Required, but never shown

























              4 Answers
              4






              active

              oldest

              votes








              4 Answers
              4






              active

              oldest

              votes









              active

              oldest

              votes






              active

              oldest

              votes









              17














              Since cut prints non-delimited lines by default the following works



              cut -f2 -d, file





              share|improve this answer


















              • 1





                It's nice when someone remember the little quirks of standard tools.

                – Kusalananda
                yesterday















              17














              Since cut prints non-delimited lines by default the following works



              cut -f2 -d, file





              share|improve this answer


















              • 1





                It's nice when someone remember the little quirks of standard tools.

                – Kusalananda
                yesterday













              17












              17








              17







              Since cut prints non-delimited lines by default the following works



              cut -f2 -d, file





              share|improve this answer













              Since cut prints non-delimited lines by default the following works



              cut -f2 -d, file






              share|improve this answer












              share|improve this answer



              share|improve this answer










              answered yesterday









              iruvariruvar

              12.4k63063




              12.4k63063







              • 1





                It's nice when someone remember the little quirks of standard tools.

                – Kusalananda
                yesterday












              • 1





                It's nice when someone remember the little quirks of standard tools.

                – Kusalananda
                yesterday







              1




              1





              It's nice when someone remember the little quirks of standard tools.

              – Kusalananda
              yesterday





              It's nice when someone remember the little quirks of standard tools.

              – Kusalananda
              yesterday













              3














              awk -F, 'NF > 1 $1 = $2 print $1 ' file


              This uses awk to parse the file as lines consisting of comma-delimited fields.



              The code detects when there is more than a single field on a line, and when there is, the first field is replaced by the second field. The first field, either unmodified or modified by the conditional code, is then printed.






              share|improve this answer























              • With a big file, this would probably be faster: awk -F, 'print(NF>1 ? $2 : $1)' -- since you won't have to rewrite $0

                – glenn jackman
                yesterday











              • @glennjackman Well, the cut solution would be even faster in any case.

                – Kusalananda
                yesterday















              3














              awk -F, 'NF > 1 $1 = $2 print $1 ' file


              This uses awk to parse the file as lines consisting of comma-delimited fields.



              The code detects when there is more than a single field on a line, and when there is, the first field is replaced by the second field. The first field, either unmodified or modified by the conditional code, is then printed.






              share|improve this answer























              • With a big file, this would probably be faster: awk -F, 'print(NF>1 ? $2 : $1)' -- since you won't have to rewrite $0

                – glenn jackman
                yesterday











              • @glennjackman Well, the cut solution would be even faster in any case.

                – Kusalananda
                yesterday













              3












              3








              3







              awk -F, 'NF > 1 $1 = $2 print $1 ' file


              This uses awk to parse the file as lines consisting of comma-delimited fields.



              The code detects when there is more than a single field on a line, and when there is, the first field is replaced by the second field. The first field, either unmodified or modified by the conditional code, is then printed.






              share|improve this answer













              awk -F, 'NF > 1 $1 = $2 print $1 ' file


              This uses awk to parse the file as lines consisting of comma-delimited fields.



              The code detects when there is more than a single field on a line, and when there is, the first field is replaced by the second field. The first field, either unmodified or modified by the conditional code, is then printed.







              share|improve this answer












              share|improve this answer



              share|improve this answer










              answered yesterday









              KusalanandaKusalananda

              140k17261436




              140k17261436












              • With a big file, this would probably be faster: awk -F, 'print(NF>1 ? $2 : $1)' -- since you won't have to rewrite $0

                – glenn jackman
                yesterday











              • @glennjackman Well, the cut solution would be even faster in any case.

                – Kusalananda
                yesterday

















              • With a big file, this would probably be faster: awk -F, 'print(NF>1 ? $2 : $1)' -- since you won't have to rewrite $0

                – glenn jackman
                yesterday











              • @glennjackman Well, the cut solution would be even faster in any case.

                – Kusalananda
                yesterday
















              With a big file, this would probably be faster: awk -F, 'print(NF>1 ? $2 : $1)' -- since you won't have to rewrite $0

              – glenn jackman
              yesterday





              With a big file, this would probably be faster: awk -F, 'print(NF>1 ? $2 : $1)' -- since you won't have to rewrite $0

              – glenn jackman
              yesterday













              @glennjackman Well, the cut solution would be even faster in any case.

              – Kusalananda
              yesterday





              @glennjackman Well, the cut solution would be even faster in any case.

              – Kusalananda
              yesterday











              1














              awk -F, 'NF == 1 print $1
              NF > 1 print $2' filename


              This will print just the first string if there is no comma, second string if there is one or more comma.






              share|improve this answer



























                1














                awk -F, 'NF == 1 print $1
                NF > 1 print $2' filename


                This will print just the first string if there is no comma, second string if there is one or more comma.






                share|improve this answer

























                  1












                  1








                  1







                  awk -F, 'NF == 1 print $1
                  NF > 1 print $2' filename


                  This will print just the first string if there is no comma, second string if there is one or more comma.






                  share|improve this answer













                  awk -F, 'NF == 1 print $1
                  NF > 1 print $2' filename


                  This will print just the first string if there is no comma, second string if there is one or more comma.







                  share|improve this answer












                  share|improve this answer



                  share|improve this answer










                  answered yesterday









                  unxnutunxnut

                  3,80721120




                  3,80721120





















                      0














                      You can do this with Perl as follows.



                      Command-line:



                      $ perl -F, -pale '$_ = $F[1] // $_' out.txt


                      Explanation:




                      • -p will read records line-by-line AND autoprint before going in to read the next or eof.


                      • -l makes IRS = ORS = "n"


                      • -F, makes FS a comma.


                      • -a splits each record $_ on the field separator, in our case a comma, and goes ahead and stores the fields so generated in the array @F, which is zero-indexed.


                      • -e implies, what follows it is the Perl code, which shall be gets applied to each record.


                      • $_ = $F[1] // $_ expression reads as follows: if the 2nd field $F[1] isn't defined, use the current record $_. And then the result of this expression is assigned to the current record $_.

                      • owing to the -p switch of perl being in use, before the new record is read in, the current record is taken to stdout.

                      Result:



                      NA
                      NA
                      NA
                      NA
                      NA
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85753
                      gene85752
                      gene85752


                      You may also do it with the GNU version of the sed editor as shown below:



                      $ sed -ne '
                      s/,/n/
                      s/.*n//
                      s/,/n/
                      P
                      ' out.txt





                      share|improve this answer



























                        0














                        You can do this with Perl as follows.



                        Command-line:



                        $ perl -F, -pale '$_ = $F[1] // $_' out.txt


                        Explanation:




                        • -p will read records line-by-line AND autoprint before going in to read the next or eof.


                        • -l makes IRS = ORS = "n"


                        • -F, makes FS a comma.


                        • -a splits each record $_ on the field separator, in our case a comma, and goes ahead and stores the fields so generated in the array @F, which is zero-indexed.


                        • -e implies, what follows it is the Perl code, which shall be gets applied to each record.


                        • $_ = $F[1] // $_ expression reads as follows: if the 2nd field $F[1] isn't defined, use the current record $_. And then the result of this expression is assigned to the current record $_.

                        • owing to the -p switch of perl being in use, before the new record is read in, the current record is taken to stdout.

                        Result:



                        NA
                        NA
                        NA
                        NA
                        NA
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85753
                        gene85752
                        gene85752


                        You may also do it with the GNU version of the sed editor as shown below:



                        $ sed -ne '
                        s/,/n/
                        s/.*n//
                        s/,/n/
                        P
                        ' out.txt





                        share|improve this answer

























                          0












                          0








                          0







                          You can do this with Perl as follows.



                          Command-line:



                          $ perl -F, -pale '$_ = $F[1] // $_' out.txt


                          Explanation:




                          • -p will read records line-by-line AND autoprint before going in to read the next or eof.


                          • -l makes IRS = ORS = "n"


                          • -F, makes FS a comma.


                          • -a splits each record $_ on the field separator, in our case a comma, and goes ahead and stores the fields so generated in the array @F, which is zero-indexed.


                          • -e implies, what follows it is the Perl code, which shall be gets applied to each record.


                          • $_ = $F[1] // $_ expression reads as follows: if the 2nd field $F[1] isn't defined, use the current record $_. And then the result of this expression is assigned to the current record $_.

                          • owing to the -p switch of perl being in use, before the new record is read in, the current record is taken to stdout.

                          Result:



                          NA
                          NA
                          NA
                          NA
                          NA
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85752
                          gene85752


                          You may also do it with the GNU version of the sed editor as shown below:



                          $ sed -ne '
                          s/,/n/
                          s/.*n//
                          s/,/n/
                          P
                          ' out.txt





                          share|improve this answer













                          You can do this with Perl as follows.



                          Command-line:



                          $ perl -F, -pale '$_ = $F[1] // $_' out.txt


                          Explanation:




                          • -p will read records line-by-line AND autoprint before going in to read the next or eof.


                          • -l makes IRS = ORS = "n"


                          • -F, makes FS a comma.


                          • -a splits each record $_ on the field separator, in our case a comma, and goes ahead and stores the fields so generated in the array @F, which is zero-indexed.


                          • -e implies, what follows it is the Perl code, which shall be gets applied to each record.


                          • $_ = $F[1] // $_ expression reads as follows: if the 2nd field $F[1] isn't defined, use the current record $_. And then the result of this expression is assigned to the current record $_.

                          • owing to the -p switch of perl being in use, before the new record is read in, the current record is taken to stdout.

                          Result:



                          NA
                          NA
                          NA
                          NA
                          NA
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85753
                          gene85752
                          gene85752


                          You may also do it with the GNU version of the sed editor as shown below:



                          $ sed -ne '
                          s/,/n/
                          s/.*n//
                          s/,/n/
                          P
                          ' out.txt






                          share|improve this answer












                          share|improve this answer



                          share|improve this answer










                          answered 16 hours ago









                          Rakesh SharmaRakesh Sharma

                          262




                          262



























                              draft saved

                              draft discarded
















































                              Thanks for contributing an answer to Unix & Linux Stack Exchange!


                              • Please be sure to answer the question. Provide details and share your research!

                              But avoid


                              • Asking for help, clarification, or responding to other answers.

                              • Making statements based on opinion; back them up with references or personal experience.

                              To learn more, see our tips on writing great answers.




                              draft saved


                              draft discarded














                              StackExchange.ready(
                              function ()
                              StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f511284%2fextract-characters-between-two-commas%23new-answer', 'question_page');

                              );

                              Post as a guest















                              Required, but never shown





















































                              Required, but never shown














                              Required, but never shown












                              Required, but never shown







                              Required, but never shown

































                              Required, but never shown














                              Required, but never shown












                              Required, but never shown







                              Required, but never shown







                              Popular posts from this blog

                              Category:Fedor von Bock Media in category "Fedor von Bock"Navigation menuUpload mediaISNI: 0000 0000 5511 3417VIAF ID: 24712551GND ID: 119294796Library of Congress authority ID: n96068363BnF ID: 12534305fSUDOC authorities ID: 034604189Open Library ID: OL338253ANKCR AUT ID: jn19990000869National Library of Israel ID: 000514068National Thesaurus for Author Names ID: 341574317ReasonatorScholiaStatistics

                              Reverse int within the 32-bit signed integer range: [−2^31, 2^31 − 1]Combining two 32-bit integers into one 64-bit integerDetermine if an int is within rangeLossy packing 32 bit integer to 16 bitComputing the square root of a 64-bit integerKeeping integer addition within boundsSafe multiplication of two 64-bit signed integersLeetcode 10: Regular Expression MatchingSigned integer-to-ascii x86_64 assembler macroReverse the digits of an Integer“Add two numbers given in reverse order from a linked list”

                              Kiel Indholdsfortegnelse Historie | Transport og færgeforbindelser | Sejlsport og anden sport | Kultur | Kendte personer fra Kiel | Noter | Litteratur | Eksterne henvisninger | Navigationsmenuwww.kiel.de54°19′31″N 10°8′26″Ø / 54.32528°N 10.14056°Ø / 54.32528; 10.14056Oberbürgermeister Dr. Ulf Kämpferwww.statistik-nord.deDen danske Stats StatistikKiels hjemmesiderrrWorldCat312794080n790547494030481-4