Combine Data from Multiple Excel Files | Most Dynamic Method (Dynamic Columns & Sheets)

Ғылым және технология

Check out our newly launched M Language course ↗️ - goodly.co.in/learn-m-powerquery/
Combining Data from Multiple Excel Files: A Dynamic Approach for Data Cleaning.
In this video, we will explore the process of combining data from multiple Excel files, which is a common data cleaning task in Excel. we will address the challenge of dynamic queries.
What if the sheet names or column names in the datasets change? How can we still efficiently combine the data? Join us as we dive into this issue and provide a dynamic solution for combining data from multiple Excel files.
#datacleaning #powerquery #dataanalysis
===== ONLINE COURSES =====
✔️ Mastering DAX in Power BI -
goodly.co.in/learn-dax-powerbi/
✔️ Power Query Course-
goodly.co.in/learn-power-query/
✔️ Master Excel Step by Step-
goodly.co.in/learn-excel/
✔️ Business Intelligence Dashboards-
goodly.co.in/learn-excel-dash...
===== LINKS 🔗 =====
Blog 📰 - www.goodly.co.in/blog/
Corporate Training 👨‍🏫 - www.goodly.co.in/training/
Need my help on a Project 💻- www.goodly.co.in/consulting/
Download File ⬇️ - goodly.co.in/combine-data-fro...
===== CONTACT 🌐 =====
Twitter - / chandeep2786
LinkedIn - / chandeepchhabra
Email - goodly.wordpress@gmail.com
===== WHO AM I? =====
A lot of people think that my name is Goodly, it's NOT ;)
My name is Chandeep. Goodly is my full-time venture where I share what I learn about Excel and Power BI.
Please browse around, you'd find a ton of interesting videos that I have created :) Cheers!

Пікірлер: 88

  • @GoodlyChandeep
    @GoodlyChandeep10 ай бұрын

    Download File ⬇ - goodly.co.in/combine-data-from-multiple-excel-files

  • @trustnoone6065
    @trustnoone60653 ай бұрын

    I'm a data analyst. Your videos are helping me a lot in real time projects. Thanks is a very small word. Love u bro

  • @IvanCortinas_ES
    @IvanCortinas_ES10 ай бұрын

    Powerful, clear, direct, controlling all scenarios => Goodly

  • @deda118
    @deda11810 ай бұрын

    Excellent pace. No frills and waste of time.

  • @roywilson9580
    @roywilson958010 ай бұрын

    Another interesting video. On the caveat - a very good reason to always familiarise yourself with the data before even starting the ETL and reporting process. I would also try to ascertain ahead of time if the content type or layout of the data is likely to change in the future and provide plenty of rem statements against anything being added or just as bad taken away add to that some kind of documentation to explain how the visuals were produced and how to edit them to include extra data or remove fields etc. that have been deprecated.

  • @udayteja6595
    @udayteja65959 ай бұрын

    This is really a comprehensive video......

  • @damionc
    @damionc6 ай бұрын

    I love your solution. Combined with your Remove junk rows video you would be able to do some transformations before promoting the headers if they were not in the first row. Great stuff.

  • @Chillman666
    @Chillman66610 ай бұрын

    Very cool idea. Bravo 👏!

  • @DinoDelight
    @DinoDelight2 ай бұрын

    Thanks, I am trying to make all my PQs unbreakable and your videos are amazing, easy to follow and live your explanation...making it simple

  • @user-fo9nk5se4z
    @user-fo9nk5se4z10 ай бұрын

    A perfect mentor ❤

  • @JG-wz6dq
    @JG-wz6dq2 ай бұрын

    Woww this is a life saver! First on youtube

  • @goodnewskasparyaodzramedo9097
    @goodnewskasparyaodzramedo909710 ай бұрын

    Good explanation, the logic so clear

  • @johnkiesel5106
    @johnkiesel51065 ай бұрын

    Clear explanation.

  • @danieljoubert7937
    @danieljoubert79374 ай бұрын

    Super cool video, thanks Sir

  • @masterjanglez
    @masterjanglez10 ай бұрын

    I have been scouring the various information sources to find a possible solution to my problem. This is exactly what I needed. Thank you thank you 🙏

  • @GoodlyChandeep

    @GoodlyChandeep

    10 ай бұрын

    Glad it helped :)

  • @cjimmer4877
    @cjimmer487710 ай бұрын

    Good stuff....thank you.

  • @Faisal63045
    @Faisal6304510 ай бұрын

    Thank you for sharing

  • @bankimdas9517
    @bankimdas951710 ай бұрын

    Thank you sir for bringing this video

  • @alexrosen8762
    @alexrosen876210 ай бұрын

    There have been numerous tutorials on this topic but not at the extent to the valuable hacks you have provided in this session. Thanks a lot 🙏

  • @GoodlyChandeep

    @GoodlyChandeep

    10 ай бұрын

    Thanks Alex :)

  • @josecarlosconejo5724
    @josecarlosconejo57249 ай бұрын

    Really good!!!

  • @vaibhavgond
    @vaibhavgond10 ай бұрын

    Thanks!

  • @davidmaldonadocastillejos3179
    @davidmaldonadocastillejos317910 ай бұрын

    Nice tip!

  • @jimgleason4040
    @jimgleason404010 ай бұрын

    You Rock, Chandeep!

  • @spen2431
    @spen243110 ай бұрын

    Amazing ! 💥💥💥💥

  • @winbin82
    @winbin8210 ай бұрын

    Wow.. amazing

  • @MrDhunpagla
    @MrDhunpagla10 ай бұрын

    Magician of excel 🎉🎉

  • @GoodlyChandeep

    @GoodlyChandeep

    10 ай бұрын

    Thanks 😉

  • @sanumpzha
    @sanumpzha10 ай бұрын

    While watching the video, I remembered that I had seen this video somewhere else and recalled where it was. Anyway, nice tutorial, Chandeep! 👍

  • @danielosorio217
    @danielosorio217Ай бұрын

    Very detailed and concise explanations! Thank you! Question: I noticed that when expanding the tables their corresponding sheet (Step 3) shows the sheet name (under the Name.1 field but underneath each sheet also the following sheet name appears _xlnm_FilterDatabase which is not a sheet in the Excel file. Under the 'Kind' column it reads 'DefinedName' with the same .xlsx extension and it is hidden. What is this other row about? Also, each Excel sheet has a drop-down menu option for some cells. The menu options is located in another non-data sheet. But, these sheets also show as a sheet name when expanding the tables which reads 'Validation List.' How do I avoid getting data from the validation sheets? I appreciate your help!

  • @abhishekawari919
    @abhishekawari91910 ай бұрын

    Nice input, whatif we have csv format data in that case how to promote header in default?

  • @jackjobriencorso
    @jackjobriencorso2 ай бұрын

    Your videos are awesome... is there any way you can list the keystrokes you do as you do them, like the important ones, but also the others, every once in a while for those jumping in a bit later to the excel party. Thanks for making great content!

  • @vtanz
    @vtanz2 ай бұрын

    Thanks for sharing your knowledge. Could you post a video for this scenario extract text multiple text files into excel, remove first 2 top rows and then split into columns and final step merge all the files to create pivot chart. Thanks

  • @julianruizd.8489
    @julianruizd.84894 ай бұрын

    Great tutorial! I am wondering... would you recommend to append a live table/tracker. I have one file per year but current year is in a table where my colleague inputs data daily. Would it be ok to combine this table with the rest?

  • @rogervandecraen9797
    @rogervandecraen97974 ай бұрын

    great tutotial and an interesting pattern. Can this be applied in the folowing case: an excel file with 12 tabs each respresenting a month and each tab contains 9 tables ordered in rows table 1 is from row 10 to 50 and column A to K ; table 2 is from row 60 to 100 and column A to K and so on to table 9 then tab feb with the same structure. how to tackle this problem , thanks in advance Roger

  • @jeremysmith6245
    @jeremysmith624510 ай бұрын

    Great Video!! I have a special issue with my data...my boss has requested I calculate the dwell time a material has spent in a location. I am having trouble calculating that. So if a material goes from the warehouse rack to a production line how do I calculate that in DAX? I have a confirmation and creation date for the pallet going both ways. I have missing confirmation dates for pallets that have not been confirmed to the destination location and it is causing errors in my calculation using datediff. Please help if you can and let me know if u require some sample data.

  • @sowmyasrinivas6259
    @sowmyasrinivas62594 ай бұрын

    Thankyou soo much. How can i skip columns in only selected sheets using M query

  • @kirux882
    @kirux88210 күн бұрын

    @ 4:29 what do I use for csv files? If I do excel.workbook it lists all the csv files I have in each table, instead of giving me the data in the csv files?

  • @abhishekawari919
    @abhishekawari91910 ай бұрын

    Thanks for the good info...can you please make a video on the problem where we have to combine multiple files or sheet having inconsistant header to map with the updated header names and then combine.

  • @GoodlyChandeep

    @GoodlyChandeep

    10 ай бұрын

    kzread.info/dash/bejne/Yo6Du5qio5DIl7w.html

  • @dharmmu
    @dharmmu10 ай бұрын

    It is good way to include all the sheets but I think, it will be always good to know what sheet you are including and not hardcode the formula. The important point was to include the data header as LIST so that it can accommodate any addition or change of the header, which is most important while combining any table from different sheet. I always use this. Can you make a video,to combine data which is in one sheet, have different data sets (not in excel table format) with some common headers and only the differentiator is at the end of each data set there is a row which start with word "Total".

  • @irfan78661
    @irfan7866110 ай бұрын

    hi, i have one question,i had created multiple pages in Power view in tabular format and i need to get export all pages and to be in workbook format as like Excel work book,please suggest

  • @mfachry3012
    @mfachry301210 ай бұрын

    What a greaat video man, but how do i activate the formula suggestion in power query excel, i use excel 2016 and also how about the origin file is not excel workbook, but it's CSV file ? Because the formula isn't work with csv file

  • @user-ue3gb4id2w
    @user-ue3gb4id2w10 ай бұрын

    hi how to updating power query when i used the I cloud ondrive or 3650 ??? thanks

  • @krisssh0097
    @krisssh009710 ай бұрын

    How to tackle promote header part if CSV file are the source data?

  • @MrJadison7
    @MrJadison710 ай бұрын

    Is there to keep the name of the excel files? Because after drilling down the name column disappears. Thank you for the awesome video.

  • @MichaelVB226

    @MichaelVB226

    8 ай бұрын

    I was trying to keep the file names also, but was not able to figure out how to accomplish this.

  • @sandroganci8817

    @sandroganci8817

    Ай бұрын

    i have the same issue, has anyone found a solution?

  • @kanthu1931
    @kanthu193110 ай бұрын

    I love your videos ❤ I have a. Excel sheet with dynamic columns is there a query that extracts only the column names i mention irrespective of new columns that get added.😊

  • @GoodlyChandeep

    @GoodlyChandeep

    10 ай бұрын

    This video might help: kzread.info/dash/bejne/nauaj6dskZbHf6g.htmlsi=9vJdjFr3WF0b-BaG

  • @mcwahaab
    @mcwahaab10 ай бұрын

    Insightful as always! Just to ask, in your courses, do you provide customized solutions to work challenges? or if there is a forum to post issues

  • @GoodlyChandeep

    @GoodlyChandeep

    10 ай бұрын

    Absolutely! My goal is to empower students to solve problems independently. I'll explain you through each Power Query concept. And yes, there's a comment section for any questions you have!

  • @mcwahaab

    @mcwahaab

    10 ай бұрын

    This is well noted and I will consider it. Thanks

  • @Steggman
    @Steggman5 ай бұрын

    Would this be live or dynamic? Example; At work we have several workbooks for different departments. I want to pull or push this data to a single master workbook. THEN if someone adds a new row to the department workbook, will that update to the master too? (i don't mind if i have to refresh rather than being 'live')

  • @bugsdenis547
    @bugsdenis5473 ай бұрын

    One challenge could be to add the filename and sheet name in the combined result

  • @bulbulahmed3098
    @bulbulahmed309810 ай бұрын

    ❤❤❤

  • @dharmendrakumar-ge3tu
    @dharmendrakumar-ge3tu8 ай бұрын

    Please tell how to convert binary into table if file format is cvs

  • @patrykmurowski7296
    @patrykmurowski729610 ай бұрын

    How can I modify this query to get the filename and sheetname column?

  • @manojjadhav4093
    @manojjadhav40933 ай бұрын

    Hi Sir Hope you doing Good!! This New update On Power Bi on 24th April has remove the Copy Data table option or it's not working in the latest version Due to what ch unable to copy the Data Table in excel Can you please help on small video ant the same pls.. I beleive no one has done that after updation

  • @afrojchuahan8133
    @afrojchuahan81335 ай бұрын

    What if I need only first sheet of workbook irrespective of name of sheet, please guide

  • @sachinsingh3898
    @sachinsingh38984 ай бұрын

    How to append multiple excel formats like xls,xlsx csv and tab delimited files together

  • @victor_wang_1
    @victor_wang_110 ай бұрын

    Good video. In the end though, all it takes is 1 other sheet that should NOT be combined to break this. After all, how could you know which sheets to combine and which sheets not to combine? What works for me: After cleaning, load all the data into an MS Access database. For go-forward, query only the latest workbook and set up an error message if the sheet name or expected columns have changed and then just change that manually. Then append that cleaned data into the Access db. Then you can query all your data with no transformations needed. I find it interesting that no content creators talk about MS Access as it's a much more scalable option than combining workbooks which can easily error.

  • @GoodlyChandeep

    @GoodlyChandeep

    10 ай бұрын

    I agree!

  • @RameezMannil
    @RameezMannil9 ай бұрын

    How to retain the filename

  • @rahulvishwakarma2119
    @rahulvishwakarma211910 ай бұрын

    👍

  • @shaffi31
    @shaffi3121 күн бұрын

    How to also add file name in the table in this steps

  • @rajukhatri
    @rajukhatri10 ай бұрын

    What if the headers are in caps in one sheet and lower case in another sheet

  • @lionels839
    @lionels8399 ай бұрын

    GOATly

  • @felipealbieri_
    @felipealbieri_5 ай бұрын

    How can I know which line is from which file if I don't have a date column?

  • @shonwilson5219
    @shonwilson521910 ай бұрын

    Sir ,when running power query "intilazation of data sources error contact your administrator" is shown could you please provide a solution for this 😢

  • @manideepak6820
    @manideepak682010 ай бұрын

    When i am combining data from multiple excel workbooks which extracted from zip format It consolidating only first 8 line items Can you please help me sir

  • @vaibhavthakur_1997
    @vaibhavthakur_199710 ай бұрын

    What to do if column header is arrange not in sequence, they are randomly. In different workbook while combine.

  • @GoodlyChandeep

    @GoodlyChandeep

    10 ай бұрын

    The order doesn't matter

  • @vaibhavthakur_1997

    @vaibhavthakur_1997

    10 ай бұрын

    @@GoodlyChandeep ok thanks

  • @surajD21
    @surajD218 ай бұрын

    What's this you are doing all days?? I don't know anything but I want to learn it. How can I learn it.

  • @RahulYadav-lp3jv
    @RahulYadav-lp3jvАй бұрын

    How can I get specific sheets from a single Excel files ?

  • @comptecharles530
    @comptecharles5302 ай бұрын

    Thank you so much for all the content you provide! If only you could spare us those fashion marks on your clothes, that would be just perfect!

  • @user-tk8zb4mz4p
    @user-tk8zb4mz4p4 ай бұрын

    thank you but how to do this with CSV files? it doesn't work when i put the (_,)

  • @Dan_De_Man
    @Dan_De_Man6 ай бұрын

    I edited the 2006 file and changed customer header to client and when I refreshed the query it just created a new column at the end called client. How do I stop it creating new column and just put the client column details into the customer column

  • @GoodlyChandeep

    @GoodlyChandeep

    6 ай бұрын

    kzread.info/dash/bejne/Yo6Du5qio5DIl7w.htmlsi=BDbKvEyw2sphXqaN

  • @vc9500
    @vc95008 ай бұрын

    Try it but it limited to 3.6k+ lines. It can’t fully combine all data 😢 How to solve it?

  • @mohammadtawhidulislam4459
    @mohammadtawhidulislam445910 ай бұрын

    = Table.TransformColumnNames(#"Filtered Rows1", {"Content", each Excel.Workbook(_)}) Then I am getting an error below- Expression.Error: We cannot convert a value of type List to type Function. Details: Value=[List] Type=[Type] Any help, please.

  • @raitup00

    @raitup00

    10 ай бұрын

    Why are you using Table.TransformColumnNames() instead of Table.TransformColumns()?

  • @mikedbman
    @mikedbmanАй бұрын

    I have an issue. When I do the Table.ExpandTableColumn (approx at 5:30 in the video) I get a "MASSIVE" Error that starts with this: Error Message:Object reference not set to an instance of an object. Stack Trace: at Microsoft.Mashup.Evaluator.EvaluationHost.OnException(IEngineHost engineHost, IMessageChannel channel, ExceptionMessage message) at Microsoft.Mashup.Evaluator.MessageHandlers.TryDispatch(IMessageChannel channel, Message message) at Microsoft.Mashup.Evaluator.MessageHandlers.Dispatch(IMessageChannel channel, Message message) at Microsoft.Mashup.Evaluator.ChannelMessenger.ChannelMessageHandlers.TryDispatch(IMessageChannel channel, Message message) at Microsoft.Mashup.Evaluator.MessageHandlers.Dispatch(IMessageChannel channel, Message message) at Microsoft.Mashup.Evaluator.Interface.IMessageChannelExtensions.WaitFor[T](IMessageChannel channel) at Microsoft.Mashup.Evaluator.RemotePreviewValueSource.PreviewValueSource.WaitFor(Func`1 condition, Boolean disposing) at Microsoft.Mashup.Evaluator.RemotePreviewValueSource.PreviewValueSource.get_TableSource() at Microsoft.Mashup.Evaluator.Interface.TracingPreviewValueSource.get_TableSource() at Microsoft.Mashup.Host.Document.Analysis.PackageDocumentAnalysisInfo.PackagePartitionAnalysisInfo.SetPreviewValue(EvaluationResult2`1 result, Func`1 getStaleSince, Func`1 getSampled) Any suggestions?

Келесі