summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)Author
2016-01-17cooker: Ensure bbappend files are processed in a determistic order1.22Richard Purdie
self.appendlist is a dict and as such unordered. This can lead to cases where appends with different names (e.g. x_%.bbappend vs. x_123.bbappend) can be reordered in application which in turn reorders the variables that those bbappend files might touch. Reorderd variables changes the sstate cache signatures causing real world issues. To avoid this, use a list for the append files instead. This patch is conservative and just adds a new data structure alongside the existing one and uses it to resolve the core issue. Later patches (post release) can handle some of the wider but less problematic ones (e.g. issues in bitbake-layers flatten). [YOCTO #7511] Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2015-04-22lib/bb/utils: add safeguard against recursively deleting things we shouldn'tPaul Eggleton
Add some very basic safeguard against recursively deleting paths such as / and /home in the event of bugs or user mistakes. Addresses [YOCTO #7620]. (Bitbake master rev: 56cddeb9e1e4d249f84ccd6ef65db245636e38ea) Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2015-04-22fetch/git: Remove a possible trailing '/' in subpathAnders Darander
If the subpath parameter to the git fetcher ends with a trailing '/', bb.utils.prunedir() will be called on '/'... Fixes [YOCTO #7620]. (Bitbake master rev: 380a3fb372c8b0a53dd7528562e6e7a222dc76ef) Signed-off-by: Anders Darander <anders@chargestorm.se> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2015-04-11data.py: fixes bad substitution when running devshellRichard Tollerton
Running bitbake inside make results in the exported environment variable MAKEOVERRIDES="${-*-command-variables-*-}", which the shell chokes on when trying to expand it. But of course, it probably shouldn't have been trying to expand it in the first place -- so just escape the dollar sign. (Bitbake rev: 18cd0ce6a55c9065c3f1bf223b47d817b5efcd8f) Signed-off-by: Richard Tollerton <rich.tollerton@ni.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> Signed-off-by: Alejandro Hernandez <alejandro.hernandez@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-06-26codeparser: Fix to better catch all getVar referencesRichard Purdie
Currently if you do localdata.getVar, the code parser simply ignores the references. Change the code to use endswith() to catch more of the references. These names are probably unique enough to get away with this. Bump the cache version to ensure things get updated. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-06-26codeparser: don't interact with the cache for subshellsChristopher Larson
Doing so was causing leakage between the execs of the main value and that of the subshell value, and was causing the cached subshell value to be used for the overall variable. At the least this could cause execs contamination between two variables that while differing, run the same subshell. Beyond that, it's possible we could have been using an incomplete cached value of a subshell for that of the main value. Before this, bb_codeparser.dat would change between parses with differing bbfile parse order. After, it does not change. The codeparser cache version is bumped, to ensure we don't use potentially incorrect cached values from previous runs. This should hopefully resolve the difficult-to-reproduce issues we've seen at Mentor Graphics where bitbake emits a script to run a task and misses dependent functions, resulting in 'command not found' failures. This issue has also been mentioned on the oe devel list, where someone hit a case where oe_runmake was missing from a do_install task (IIRC). Adding debug information showed that bitbake's information about the variable dependencies for this task is inaccurate in the failure cases. Signed-off-by: Christopher Larson <kergoth@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-06-20toaster: Fix spacing and layout in no image files notificationBelen Barros
Close the definition list before adding the notification, and restrict the notification width to avoid uncomfortable line lenghts. Signed-off-by: Belen Barros <belen.barros.pena@intel.com> Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-06-20toaster: display message if no images are generatedFarrell Wymore
Display message if no images are generated for a target. This commit was amended to have more conditions for displaying the message. [YOCTO #6094] Signed-off-by: Farrell Wymore <farrell.wymore@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-06-20toaster: Add performance testing scriptIonut Chisanovici
This is implemented as a django management command. For the moment the 'manage.py perf' command will track the toaster 'gui' urls http response code and load time. To use it: 1. do your toaster builds 2. ensure toaster is started 1. cd bitbake/lib/toaster 2. ln -s ../../../build/toaster.sqlite 3. ./manage.py perf Signed-off-by: Ionut Chisanovici <ionutx.chisanovici@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-06-20toaster: refactor the target pageFarrell Wymore
the target (packages) page had to refactored to allow the displays to differ depending on the caller namely the license manifest link. Amended to make the link from the tag rather than the pathname itself. [YOCTO #6291] [YOCTO #6079] Signed-off-by: Farrell Wymore <farrell.wymore@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-06-20toastergui: fix built ETA calculationAlexandru DAMIAN
We fix the calculation showing the estimated time to build completion. Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com>
2014-06-20toaster: reduce redundant foreign key lookupsDavid Reyna
Replace redundant foreign key lookups with "with" to improve all recipes page load time. Do depends pre-lookup in the view class, and use python itertation instead of filter() all to achieve x16 processing speedup. [YOCTO #6137] Signed-off-by: David Reyna <David.Reyna@windriver.com> Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Conflicts: bitbake/lib/toaster/toastergui/views.py Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-06-20toaster: sort columns properly after edit columnsFarrell Wymore
If a sorted column is made invisible through the edit columns function, resort the table the its default order. [YOCTO 5919] Signed-off-by: Farrell Wymore <farrell.wymore@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-06-20toaster: fix span2 headings for packagesDave Lerner
[YOCTO 6147] Fix bug in views.py that put 'span2' class id in a 'clclass' key instead of the 'dclass' key. This fix exposed another problem in target.html and the target view function that used 'package_size' instead of 'size' as the 'clclass' which is inconsistent with the model field name, causing table data columns to be shown when the header is hidden. Signed-off-by: Dave Lerner <dave.lerner@windriver.com>
2014-06-20toaster: sort outcome and sstate columns by string valueDavid Reyna
Sort the 'outcome' and 'sstate_result' columns by their description string values and not their numerical values. [YOCTO #5921] Signed-off-by: David Reyna <David.Reyna@windriver.com>
2014-06-20bitbake: toaster: Fix Empty tasks filterBelen Barros Pena
Somehow the counter was set to count tasks with outcome 'not available', instead of outcome 'empty'. This patch fixes the problem. [YOCTO #6146] Signed-off-by: Belen Barros Pena <belen.barros.pena@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-06-20bitbake: toaster: Fix total number of tasks in build dashboardBelen Barros Pena
The total number of tasks in the build dashboard was counting _setscene tasks, which are not exposed by Toaster as separate tasks. This patch makes sure that _setscene tasks are not counted when calculating that number. [YOCTO #6145] Signed-off-by: Belen Barros Pena <belen.barros.pena@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-05-29fetch2/hg: Fix missing proto param for hg checkout with user and pwVolker Vogelhuber
A fix for the former patch when checking out a repository with username and password using HG Signed-off-by: Volker Vogelhuber <v.vogelhuber@digitalendoscopy.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-05-29data_smart: Fix an unusual variable reference bugRichard Purdie
If you try: Y = "" Y_remove = "X" in OE-Core, bitbake will crash with a KeyError during expansion. The reason is that no expansion of the empty value is attempted but removal from is it and hence no varparse data is present for it in the expand_cache. If the value is empty, there is nothing to remove so the best fix is simply not to check for None but check it has any value. Also add a test for this error so it doesn't get reintroduced. (Bitbake rev: af3ce0fc0280e6642fa35de400f75fdbabf329b1) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-05-29fetch2/perforce: Ensure command has a defaultRichard Purdie
Ensure there is default command available if FETCHCMD_p4 isn't set. Also clean up the getVar references whilst here. (Bitbake rev: d150226d11d5f041f78c8c3ce4abc5465dbc81d8) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-05-29fix cloning of mercurial repository with username and password specified in urlVolker Vogelhuber
(Bitbake rev: 9a328262e047562a6edf7b2ec7b8a1949e287cbe) Signed-off-by: Volker Vogelhuber <v.vogelhuber@digitalendoscopy.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-05-29Fix refetch of local files when they are read onlyNick Lewis
(Bitbake rev: 42b7be1a6c5ff559f4a213eed04b370ca955460d) Signed-off-by: Nick Lewis <nick.lewis@usa.g4s.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-05-29HG Fetch with username and password in urlVolker Vogelhuber
Following up a previous patch for mercurial fetcher, I just fixed a problem when calling update on a repository with subrepositories enabled. Attached a patch that fixes this problem >From caae519a2bd64bf7c729bb26aff344827def47fb Mon Sep 17 00:00:00 2001 From: Volker Vogelhuber <v.vogelhuber@digitalendoscopy.de> Date: Tue, 29 Apr 2014 15:29:47 +0200 Subject: [PATCH] bitbake: - fixed authentication issues in case of using sub repositories (Bitbake rev: dfa041c940caad12da50126a559afc8de089eeda) Signed-off-by: Volker Vogelhuber <v.vogelhuber@digitalendoscopy.de> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-05-29bitbake-diffsigs: Fix runtime error when no arguments are givenJacob Kroon
If bitbake-diffsigs is run without arguments it will error: Traceback (most recent call last): File "./bin/bitbake-diffsigs", line 121, in <module> if output: NameError: name 'output' is not defined Fix this by moving the check for output into the inner else-clause. (Bitbake rev: 7d3545a66863ad7183a7650b2af57eee091c45ae) Signed-off-by: Jacob Kroon <jacob.kroon@mikrodidakt.se> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-05-29runqueue: Fix task weighting algorithmRichard Purdie
When looking at a list of tasks, do_patch and do_unpack were being given equal priority when one clearly depends on another. The reason for this was the default task weights of 0 being to tasks. This is therefore changed to 1 to allow correct weighting of dependencies which means the scheduler has better information available to it about tasks. Weight endpoints differently (10) for clearer debugging of priorities. (Bitbake rev: 12dc1d17fac3e8ec420fcafb06186d32fd847d89) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-05-29runqueue: Fix handling of zero priority taskRichard Purdie
The zero priority task should be run first but was being confused with the None value the priority field defaulted to. Check for None explicitly to avoid this error. In the real world this doesn't change much but it confused the debug output from the schedulers. (Bitbake rev: 49c9d8c9400f74c804c2f36462639236e0841ff0) Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-04-21bitbake-user-manual-hello.xml: Edits to the "Hello World" Appendix.Scott Rifenbark
Fixes [YOCTO #1973] These are review changes applied from Paul Eggleton. Signed-off-by: Scott Rifenbark <scott.m.rifenbark@intel.com>
2014-04-21bitbake-user-manual-hello.xml: First draft of "Hello World" appendixScott Rifenbark
Fixes [YOCTO #1973] Added the complete "Hello World" appendix first draft beyond what Bill Traynor had supplied. Signed-off-by: Scott Rifenbark <scott.m.rifenbark@intel.com>
2014-04-21bitbake-user-manual-hello.xml: Edits to environment for hello world.Scott Rifenbark
Some general edits to the sections that get you set up to run the "Hello World" example. Signed-off-by: Scott Rifenbark <scott.m.rifenbark@intel.com>
2014-04-21bitbake-user-manual-metadata.xml: Added section on pathname syntaxScott Rifenbark
Added a brief subsection to the "Basic Syntax" section that describes the issue using the tilde character (~) when providing a pathname as part of a statement. BitBake does not expand this character like the shell does. We recommend to not use it in pathnames. Signed-off-by: Scott Rifenbark <scott.m.rifenbark@intel.com>
2014-04-21bitbake-user-manual-ref-variables.xml: Edits to the BBPATH variable.Scott Rifenbark
I took the stuff about running bitbake outside the build directory and removed the note syntax. Signed-off-by: Scott Rifenbark <scott.m.rifenbark@intel.com>
2014-04-21bitbake-user-manual-ref-variables.xml: Fixed BBPATH exampleScott Rifenbark
The example used in the note in the BBPATH variable description had incorrect syntax. Spaces existed in the BBPATH = statement. I have removed them. Signed-off-by: Scott Rifenbark <scott.m.rifenbark@intel.com>
2014-04-21user-manual-hello.xml: General editsScott Rifenbark
I worked through the chapter and made some minor edits based on my user experience. Part of what I did was to update the console output for the examples. Signed-off-by: Scott Rifenbark <scott.m.rifenbark@intel.com>
2014-04-21bitbake-user-manual-hello.xml: Fixed two broken links.Scott Rifenbark
Signed-off-by: Scott Rifenbark <scott.m.rifenbark@intel.com>
2014-04-21bitbake-user-manual-metadata.xml: New section on anonymous Python functionsScott Rifenbark
Per Paul Eggleton's suggestion, I added a new section on anonymous Python functions into the "Functions" section. I also updated the intro text to account for the added type of functions. Signed-off-by: Scott Rifenbark <scott.m.rifenbark@intel.com>
2014-04-21bitbake-user-manual-metadata.xml: Edits to flexible inheritance section.Scott Rifenbark
Fixes [YOCTO #5472] Applied review edits from Paul Eggleton to this section. Minor edits and some re-writing. Signed-off-by: Scott Rifenbark <scott.m.rifenbark@intel.com>
2014-04-11doc: Rename user-manual -> bitbake-user-manualRichard Purdie
This manual gets combined with other manuals and in that context, it helps a lot if its seen as the Bitbake User Manual. Renames are a pain but this is worthwhile so that other docs can correctly be combined with this one. This also clarifies things like google search results which is helpful. Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-04-10bitbake: Update to version 1.22.0Richard Purdie
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-04-10cache: don't trigger reparse on recipes with wildcards in SRC_URIPaul Eggleton
Since we now get wildcards in the file checksum list in the cache, we need to ignore them when checking to see if they still exist. This fixes connman-gnome reparsing on every bitbake execution in OE-Core. Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-04-09toaster: Allow toaster to start without pytzAlexandru DAMIAN
This patch allows toaster to start without pytz. Django can work with or without pytz, but in the time zone fix I mistakenly added a hard dependency on this module. This patch eliminates the hard dependency. Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-04-09toaster: add URI search path listDavid Reyna
Display the URI paths from SSTATE_DIR and SSTATE_MIRRORS in the Task page. [YOCTO #5996] Signed-off-by: David Reyna <David.Reyna@windriver.com> Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-04-09toaster: sort on size in detail pagesDave Lerner
[YOCTO 5778] Implements the features described in the attachment to bugzilla 5778 - new global changes to the format of size data, and - adding sorts by selected columns to specific detail pages. Although new pagination and row search capabilities are shown on the screen shots for the 5778 attachment, those features are specified in a different bugzilla entry 5777 and are not implemented in this commit. Also, the 5778 spec includes table sorting for the recipe package detail page, but sorting for that page was not implemented in this commit due to complications with sorting then returning to a page that is only one URL fragment in a template. The scope of file changes are described below. Changes to support new 'size' field column formats... default.css - added sizecol class style (right justified) projecttags.py - changed filtered_filesizeformat to allow ".0" suffixes Changes that add class 'sizecol, span2(as spec'd) ' to <th> and/or <td> size columns were made to... dirinfo.py, package_built_dependencies.html, package_included_dependencies.html, recipe.html, bpackage.html, and target.html More significant changes to support detail page table sorting are: - tablesort.html: New created to implement the sort icons, directions, and table headings, and suppress sort handling if 'disable_sort' in context, without search or pagination elements ingrained in basetable_top. Confining the changes to this small file reduces the impact (testing and risk) on the larger set of files that arleady include basetable_top/bottom files. - view.py: Modified the following view functions with - trivial changes for size formatting to the views: target, - changes to package_built_detail, package_included_detail, package_included_reverse_dependencies to handle the sorting implementation as well as moving headings and size formatting for size columns from templates to the views. - Implementation of the detail sorting using above in: package_built_detail.html, package_included_detail.html, and package_included_reverse_dependencies.html to include the tablesort heading setup, format the size column, and iterate over the new sorted objects, suppressing sorts if table row count less than 2. Signed-off-by: Dave Lerner <dave.lerner@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-04-09toaster: hide tasks without order or outcomeDavid Reyna
Hide the incomplete tasks, those without order numbers and/or outcomes. [YOCTO #6060] Signed-off-by: David Reyna <David.Reyna@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-04-09toaster: regex alternation filter caused django errorDavid Reyna
The combination of a regex filter specification that uses alternate, plus a search string, plus multiple search_allowed_fields, leads to a Django fatal error. Replace this regex filter for variables in local files with a simpler 'contains' against the project's directory plus a '/conf/' string. Alex rebased this on top of fix for #6048. [YOCTO #5962] Signed-off-by: David Reyna <David.Reyna@windriver.com> Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-04-09toaster: fix filtering query for multiple filtersAlexandru DAMIAN
This is a fix for using multiple expressions in filters. Three different issues are touched: * added an explicit error message for incorrect filter usage * changed the value separator to something that will pass through from the browser to the actual code * changed the "and" operator for combining Q from a dubios lambda function to the standard operator.and_ Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-04-09toaster: keep number of rows across searchesAlexandru DAMIAN
This patch will make Toaster remember the selected number of rows to be displayed in tables across different searches. The number of rows setting will not be remembered if the the user leaves the page and subsequently returns to it. Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-04-09toaster: show unique set-in files in configvarDavid Reyna
When listing the set-in files in the configure varaible table, only show each file once in that summary view. [YOCTO #6048] Signed-off-by: David Reyna <David.Reyna@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-04-09toaster: disable 'size over total' sortDave Lerner
[YOCTO 6061] Disable size-over-total table column sorts in the image installed packages view because that field is a computed field and only model fields are sortable in the current table toaster implementation. Signed-off-by: Dave Lerner <dave.lerner@windriver.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-04-09toaster: do not load all available timezonesAlexandru DAMIAN
This patch makes sure that we only load pytz-recognized timezones. Pytz is used to transform the timezone information for the database queries, and needs to be able to deal with the TIME_ZONE value that we set up. [YOCTO #6093] Signed-off-by: Alexandru DAMIAN <alexandru.damian@intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
2014-04-09bitbake-selftest: add tests for local fetchingPaul Eggleton
Add some explicit tests for unpacking local files to the appropriate location. Some of these tests are actually testing for broken behaviour; these have been called out in the comments, and associated bugs have been filed. Signed-off-by: Paul Eggleton <paul.eggleton@linux.intel.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>